-- Logs begin at Fri 2022-06-24 14:18:12 UTC, end at Fri 2022-06-24 15:42:15 UTC. -- Jun 24 15:09:56.280408 dv-cinder-835384-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 15:09:56.288675 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 15:09:56 2022] *** Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: nodename: dv-cinder-835384-11-iscsi Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: machine: x86_64 Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: clock source: unix Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: pcre jit disabled Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: detected number of CPU cores: 4 Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: current working directory: / Jun 24 15:09:56.290645 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: detected binary path: /usr/bin/uwsgi-core Jun 24 15:09:56.291373 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: your processes number limit is 47680 Jun 24 15:09:56.291373 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: your memory page size is 4096 bytes Jun 24 15:09:56.291373 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: detected max file descriptor number: 2048 Jun 24 15:09:56.291373 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: lock engine: pthread robust mutexes Jun 24 15:09:56.291373 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: thunder lock: enabled Jun 24 15:09:56.291373 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 15:09:56.291373 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 15:09:56.335843 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: Python main interpreter initialized at 0x555e2ccec9c0 Jun 24 15:09:56.335843 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: python threads support enabled Jun 24 15:09:56.335843 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: your server socket listen backlog is limited to 100 connections Jun 24 15:09:56.335843 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: your mercy for graceful operations on workers is 90 seconds Jun 24 15:09:56.336215 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 15:09:56.336293 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: *** Operational MODE: preforking *** Jun 24 15:09:56.336528 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: *** uWSGI is running in multiple interpreter mode *** Jun 24 15:09:56.336528 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: spawned uWSGI master process (pid: 103761) Jun 24 15:09:56.336724 dv-cinder-835384-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 15:09:56.337298 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: spawned uWSGI worker 1 (pid: 103762, cores: 1) Jun 24 15:09:56.337653 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: spawned uWSGI worker 2 (pid: 103763, cores: 1) Jun 24 15:09:56.337824 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 15:09:57.009211 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 15:09:57.017367 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 15:09:58.155074 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:09:58.155074 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: from cryptography.utils import int_from_bytes Jun 24 15:09:58.155718 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:09:58.155718 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: from cryptography.utils import int_from_bytes Jun 24 15:09:58.212157 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:09:58.212157 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: from cryptography.utils import int_from_bytes Jun 24 15:09:58.212708 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:09:58.212708 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: from cryptography.utils import int_from_bytes Jun 24 15:10:00.652952 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 15:10:00.653612 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 15:10:00.653703 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 15:10:00.654065 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 15:10:00.654317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 15:10:00.654700 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.655023 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.655371 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.655565 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 15:10:00.655929 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.656025 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 15:10:00.656097 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.656296 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.656400 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 15:10:00.656615 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.656707 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 15:10:00.656931 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.657023 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 15:10:00.657255 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.657354 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.657518 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.657669 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.657831 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.657936 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.658155 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-11-iscsi {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.658256 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.658473 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.658582 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.658778 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.658867 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.659086 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.659194 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.659429 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.659520 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.659735 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.659824 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.660032 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.660126 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.660346 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.660444 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.660667 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-11-iscsi {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.660839 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.660989 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.661282 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.661372 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.661590 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.661677 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.661902 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.661989 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.662205 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.662298 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.662527 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.662623 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.662830 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.662986 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.663149 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.663355 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.663478 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.663667 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.663797 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.663975 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.664091 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.664286 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.664483 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-11-iscsi {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.664621 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.664798 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.664933 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.665108 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.665242 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.665418 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.665560 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.665842 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.666052 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.666166 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.666282 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.666407 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.666504 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.667263 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.667416 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-11-iscsi {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.667849 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.668081 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.668224 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.668400 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.668501 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.668713 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.668802 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.669074 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.669161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.669387 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.669488 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.669685 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.669783 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.669989 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.670084 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.670293 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.670396 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.670607 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.670695 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.670909 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.671003 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.671228 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.671335 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.671478 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.671567 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.671783 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.671871 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.672097 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.672195 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.672411 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.672499 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.672728 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.672817 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.672978 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.673067 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.673223 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.673349 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.673543 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.673638 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.673857 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.673949 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.674161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.674247 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.674463 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.674631 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.674764 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.674852 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.675066 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.675154 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.675367 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.675470 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.675619 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.675714 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.675937 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.676026 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.676256 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.676345 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.676565 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.676659 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.676872 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.676957 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.677179 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.677275 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.677482 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.677571 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.677791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.677876 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.678099 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.678187 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.678405 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.678503 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.678708 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.678803 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.679023 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.679109 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.679374 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.679462 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.679681 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.679781 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.679991 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.680076 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.680305 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.680392 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.680609 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.680709 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.680912 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.681000 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.681222 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.681319 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.681532 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.681630 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.681855 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.681941 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.682155 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.682263 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.683090 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.683201 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.683425 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.683512 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.683736 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.683860 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.684056 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.684152 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.684364 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.684451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.684670 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.684756 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.684976 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.685064 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.685275 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.685361 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.685539 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.685639 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.685839 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.685927 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.686144 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.686232 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.686449 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.686548 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.686754 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.686841 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.687056 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.687142 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.687384 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.687484 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.687686 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.687775 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.687987 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.688073 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.688292 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.688436 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.688599 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.688695 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.688900 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.688988 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.689204 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.689318 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.689505 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.689599 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.689806 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.689893 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.690108 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.690207 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.690407 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.690493 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.690712 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.690800 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.691027 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.691128 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.691357 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.691449 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.691662 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.691757 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.691969 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.692093 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.692268 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.692355 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.692571 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.692658 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.692875 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.692974 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.693169 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.693259 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.693479 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.693578 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.693781 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.693880 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.694082 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.694171 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.694385 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.694472 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.694686 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.694782 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.694987 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.695083 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.695313 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.695403 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.695613 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.695700 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.695911 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.695997 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.696212 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.696347 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.696509 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.696625 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.696813 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.696929 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.697111 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.697225 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.697416 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.697523 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.697715 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.697802 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.698077 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.698174 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.698395 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.698518 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.698704 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.698791 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.699005 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.699101 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.699335 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.699425 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.699660 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.699749 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.699970 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.700068 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.700279 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.700375 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.700585 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.700679 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.700902 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:10:00.700992 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.701218 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.701342 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.701542 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.701637 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.701855 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.701954 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.702168 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.702262 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.702480 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.702574 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.702799 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.702934 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.703117 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.703271 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.703455 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.703563 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.703770 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.703867 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.704085 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.704171 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.704395 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.704505 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.704704 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.704800 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.705012 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.705105 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.705332 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.705425 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.705650 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.705738 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.705961 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.706049 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.706281 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.706385 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.706604 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.706694 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.706923 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.707017 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.707258 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.707367 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.707576 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.707664 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.707888 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.707983 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.708198 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.708294 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.708507 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.708640 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.708826 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.708913 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.709154 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.709255 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.709463 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.709550 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.709779 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.709866 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.710089 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.710178 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.710399 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.710487 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.710707 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.710793 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.711014 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.711101 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.711358 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.711458 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.711689 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.711776 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.712002 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.712134 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.712315 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.712403 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.712625 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.712714 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.712936 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.713023 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.713243 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.713335 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.713580 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.713678 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.713891 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.714098 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.714229 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.714443 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.714538 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.714763 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.714851 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.715069 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.715164 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.715398 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.715486 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.715717 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.715807 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.716031 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.716130 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.716335 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.716422 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.716652 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.716739 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.716957 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.717052 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.717261 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.717353 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.717566 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.717654 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.717875 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.717961 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.718177 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.718272 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.718487 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.718574 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.718797 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.718885 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.719102 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.719224 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.719448 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.719536 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.719760 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.719846 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.720061 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.720158 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.720373 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.720460 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.720673 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.720771 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.720976 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.721071 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.721286 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.721384 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.721594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.721681 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.721901 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.722005 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.722202 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.722294 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.722510 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.722610 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.722813 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.722901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.723129 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.723288 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.723459 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.723598 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.723768 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.723864 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.724085 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.724173 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.724391 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.724488 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.724702 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.724798 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.725015 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.725102 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.725325 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.725421 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.725627 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.725715 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.725936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.726023 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.726237 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.726333 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.726540 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.726628 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.726840 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.726928 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.727148 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.727314 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.727474 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.727563 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.727777 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.727869 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.728080 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.728180 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.728380 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.728469 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.728681 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.728768 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.729018 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.729618 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.729820 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.729916 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.730142 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.730228 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.730455 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.730544 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.730761 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.730850 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.731068 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.731164 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.731400 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.731491 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.731708 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.731796 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.732013 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.732100 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.732335 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.732424 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.732647 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.732736 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.732952 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.733050 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.733258 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.733346 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.733562 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.733707 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.733875 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.733971 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.734185 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.734274 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.734493 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.734591 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.734811 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.734908 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.735119 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.735238 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.735461 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.735548 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.735770 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.735866 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.736089 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.736176 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.736395 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.736489 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.736707 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.736795 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.737007 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.737094 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.737321 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.737408 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.737640 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.737728 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.737955 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.738044 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.738270 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.738356 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.738579 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.738668 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.738884 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.738970 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.739222 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.739315 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.739528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.739624 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.739832 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.739926 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.740136 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.740223 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.740443 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.740542 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.740756 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.740844 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.741063 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.741158 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.741376 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.741464 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.741682 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.741769 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.741998 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.742093 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.742306 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.742394 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.742616 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.742711 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.742915 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.743015 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.743250 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.743342 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.743574 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.743661 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.743886 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.743984 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.744205 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.744292 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.744513 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.744601 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.745436 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.745537 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.745751 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.745866 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.746074 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.746161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.746381 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.746478 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.746697 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.746792 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.747030 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.747125 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.747378 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.747468 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.747685 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.747800 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.747993 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.748083 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.748301 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.748397 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.748603 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.748692 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.748910 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.749006 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.749215 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.749302 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.749517 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.749603 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.749815 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.749911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.750124 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.750211 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.750438 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.750531 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.750743 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.750838 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.751051 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.751147 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.751381 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.751470 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.751690 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.751790 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.751995 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.752090 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.752297 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.752384 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.752601 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.752704 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.752900 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.752994 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.753207 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.753302 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.753510 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.753599 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.753830 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.753954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.754151 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.754238 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.754454 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.754542 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.754757 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.754844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.755077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.755172 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.755412 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.755501 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.755715 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.755800 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.756018 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.756106 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.756322 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.756410 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.756637 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.756722 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.756952 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.757049 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.757259 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.757353 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.757566 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.757654 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.757875 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.757978 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.758184 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.758270 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.758488 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.758576 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.758797 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.758901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.759105 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.759209 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.759441 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.759528 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.759749 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.759849 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.760053 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.760141 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.760386 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.760472 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.760713 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.760800 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.761026 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.761270 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.761358 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.761602 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.761698 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.761917 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.762005 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.762236 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.762321 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.762546 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.762643 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.762852 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.762946 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.763164 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.763290 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.763507 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.763607 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.763845 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.764072 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.764174 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.764411 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.764506 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.764730 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.764827 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.765031 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.765125 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.765346 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.765434 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.765652 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.765740 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.765957 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.766045 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.766261 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.766361 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.766572 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.766661 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.766876 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.766980 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.767199 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.767288 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.767504 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.767606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.767810 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.767899 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.768125 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.768212 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.768429 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.768525 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.768733 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.768829 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.769033 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.769119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.769340 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.769436 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.769645 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.769744 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.769944 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.770031 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.770245 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.770344 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.770544 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.770631 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.770858 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.770952 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.771163 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.771274 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.771507 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.771606 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.771812 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.771900 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.772136 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.772225 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.772443 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.772531 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.772745 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.772844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.773050 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.773146 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.773351 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.773446 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.773653 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.773748 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.773962 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.774058 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.774270 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.774368 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.774578 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.774675 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.774879 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.774969 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.775285 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.775378 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.775521 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.775625 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.775828 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.775918 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.776161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.776360 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.776448 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.776757 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.776857 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.777057 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.777146 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.777369 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.777465 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.777678 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.777767 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.777980 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.778067 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.778279 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.778440 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.778587 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.778675 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.778895 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.778995 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.779213 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.779315 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.779524 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.779618 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.779823 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.779909 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.780125 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.780220 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.780423 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.780512 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.780724 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.780811 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.781023 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.781120 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.781326 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.781412 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.781630 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.781716 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.781931 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.782019 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.782231 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.782318 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.782540 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.782628 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.782839 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.782926 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.783139 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.783242 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.783466 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.783552 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.783766 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.783854 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.784066 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.784153 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.784371 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.784457 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.784676 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.784763 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.784980 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.785069 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.785278 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.785374 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.785585 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.785680 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.785885 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.785973 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.786186 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.786281 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.786484 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.786570 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.786784 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.786870 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.787081 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.787216 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.787407 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.787504 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.787708 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.787796 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.788008 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.788105 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.788310 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.788400 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.788618 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.788705 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.788920 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.789010 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.789218 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.789312 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.789519 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.789614 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.789818 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.789908 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.790118 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.790205 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.790422 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.790512 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.790725 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.790814 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.791027 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.791115 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.791356 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.791445 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.792242 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.792389 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.792839 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.793088 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.793181 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.793338 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.793453 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.793651 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.793739 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.793958 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.794047 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.794307 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.794438 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.794615 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.794705 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.794931 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.795058 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.795258 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.795351 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.795575 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.795663 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.795883 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.795972 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.796189 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.796285 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.796505 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.796600 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.796823 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.796922 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.797131 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.797220 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.797429 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.797517 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.797737 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.797833 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.798046 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.798134 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.798350 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.798445 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.798655 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.798755 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.798961 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.799049 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.799291 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.799381 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.799600 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.799698 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.799907 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.799995 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.800216 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.800304 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.800521 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.800620 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.800822 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.800910 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.801129 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.801218 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.801438 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.801527 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.801739 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.801834 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.802049 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.802135 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.802353 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.802493 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.802653 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.802741 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.802956 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.803059 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.803287 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.803381 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.803597 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.803685 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.803898 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.803995 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.804204 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.804318 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.804515 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.804624 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.804827 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.804928 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.805135 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.805223 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.805460 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.805548 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.805772 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.805867 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.806077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.806172 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.806387 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.806475 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.806684 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.806780 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.806996 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.807084 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.807969 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.808133 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.808342 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.808454 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.808579 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.808667 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.808881 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.808970 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.809185 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.809274 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.809491 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.809587 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.809810 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.809898 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.810112 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.810201 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.810413 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.810501 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.810712 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.810806 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.811028 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.811239 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.811356 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.811525 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.811672 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.811843 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.812081 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.812169 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.812391 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.812479 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.812691 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.812788 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.813044 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.813139 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.813367 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.813454 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.813675 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.813774 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.813983 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.814070 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.814290 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.814438 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.814612 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.814708 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.814915 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.815011 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.815250 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.815342 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.815562 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.815655 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.815882 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.815978 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.816202 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.816297 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.816510 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.816663 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.816825 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.816977 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.817127 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.817289 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.817444 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.817612 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.817762 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.817940 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.818073 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.818264 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.818387 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.818572 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.818795 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.818894 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.819117 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.819220 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.819467 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.819554 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.819788 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.819878 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.820112 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.820200 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.820416 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.820512 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.820719 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.820806 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.821029 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.821116 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.821330 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.821430 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.821632 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.821720 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.821952 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.822040 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.822254 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.822350 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.822560 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.822696 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.822880 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.823045 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.823244 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.823400 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.823512 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.823807 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.823904 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.824118 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.824216 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.824424 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.824511 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.824733 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.824820 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.825041 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.825138 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.825349 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.825437 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.825664 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.825750 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.825967 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.826069 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.826280 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.826374 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.826584 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.826678 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.826886 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.826983 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.827198 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.827290 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.827513 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.827600 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.827835 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.827933 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.828141 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.828228 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.828460 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.828548 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.828774 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.828862 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.829094 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.829181 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.829399 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.829487 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.829706 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.829794 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.830028 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.830116 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.830340 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.830428 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.830647 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.830737 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.830953 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.831049 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.831276 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.831379 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.831578 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.831667 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.831887 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.831982 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.832188 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.832289 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.832490 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.832579 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.832791 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.832881 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.833099 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.833195 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.833399 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.833488 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.833699 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.833787 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.834002 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.834098 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.834321 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.834409 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.834625 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.834722 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.834942 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.835032 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.835287 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.835391 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.835575 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.835663 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.835876 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.835965 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.836179 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.836268 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.836483 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.836576 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.836792 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.836882 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.837097 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.837184 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.837401 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.837488 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.837704 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.837794 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.838032 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.838127 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.838336 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.838432 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.838743 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.838831 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.839137 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.839308 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.839472 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.839574 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.839781 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.839870 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.840086 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.840181 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.840432 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.840533 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.840741 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.840831 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.841051 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.841138 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.841361 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.841457 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.841672 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.841761 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.841984 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.842072 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.842297 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.842386 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.842620 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.842810 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.842938 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.843141 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.843267 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.843488 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.843578 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.843806 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.843894 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.844121 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.844217 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.844434 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.844529 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.844751 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.844846 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.845065 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.845170 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.845376 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.845465 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.845686 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.845777 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.845997 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.846088 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.846322 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.846514 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.846638 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.846849 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.846946 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.847167 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.847303 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.847509 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.847600 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.847829 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.848045 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.848158 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.848246 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.848474 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.848573 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.848788 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.848878 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.849101 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.849190 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.849415 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.849510 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.849727 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.849817 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.850056 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.850144 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.850371 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.850471 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.850685 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.850775 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.850992 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.851086 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.851333 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.851440 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.851644 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.851732 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.851954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.852041 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.852262 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.852359 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.852572 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.852673 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.852883 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.853018 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.853201 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.853291 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.853514 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.853609 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.853833 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.853921 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.854660 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.854756 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.854985 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.855233 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.855339 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.855563 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.855698 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.855926 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.856083 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.856238 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.856400 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.856549 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.856731 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.856861 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.857054 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.857175 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.857376 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.857499 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.857690 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.857835 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.858005 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.858156 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.858331 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.858476 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.858637 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.858790 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.858942 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.859108 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.859278 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.859589 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.859686 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.859893 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.859982 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.860212 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.860314 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.860523 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.860619 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.860826 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.860914 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.861145 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.861241 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.861454 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.861542 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.861801 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.861977 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.862109 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.862316 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.862406 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.862629 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.862717 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.862952 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.863088 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.863300 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.863391 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.863615 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.863702 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.863921 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.864021 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.864223 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.864319 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.864530 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.864617 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.864833 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.864968 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.865153 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.865361 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.865460 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.865706 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.865845 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.866023 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.866113 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.866342 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.866429 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.866651 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.866748 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.866956 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.867052 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.867283 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.867373 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.867585 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.867685 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.867900 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.867987 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.868202 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.868297 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.868507 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.868603 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.868808 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.868903 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.869111 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.869199 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.869411 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.869507 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.869731 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.870407 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.870629 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.870724 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.870937 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.871034 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.871273 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.871376 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.871580 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.871669 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.871908 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.871998 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.872214 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.872304 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.872520 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.872608 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.872824 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.872920 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.873130 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.873217 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.873435 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.873522 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.873740 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.873829 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.874044 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.874132 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.874351 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.874453 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.874663 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.874753 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.874967 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.875101 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.875300 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.875405 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.875611 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.875705 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.875921 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.876010 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.876225 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.876322 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.876535 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.876624 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.876886 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.877073 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.877209 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.877404 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.877501 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.877722 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.877818 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.878055 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.878224 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.878386 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.878478 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.878690 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.878780 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.878994 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.879090 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.879322 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.879414 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.879646 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.879736 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.879955 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.880052 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.880266 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.880490 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.880587 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.880827 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.880915 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.881150 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.881241 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.881458 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.881545 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.881764 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.881862 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.882072 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.882167 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.882380 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.882476 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.882684 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.882790 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.882989 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.883076 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.883318 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.883422 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.883627 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.883725 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.883938 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.884027 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.884251 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.884337 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.884562 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.884652 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.884873 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.884962 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.885184 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.885274 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.885518 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.885609 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.885827 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.886179 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.886267 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.886483 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.886581 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.886791 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.886879 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.887100 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.887254 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.887439 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.887541 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.887747 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.887834 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.888048 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.888137 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.888390 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.888525 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.888717 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.888806 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.889037 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.889134 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.889351 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.889440 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.889659 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.889747 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.889968 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.890055 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.890279 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.890378 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.890580 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.890668 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.890894 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.890999 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.891220 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.891310 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.891548 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.891638 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.891852 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.891948 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.892189 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.892277 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.892508 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.892604 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.892807 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.892904 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.893105 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.893194 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.893404 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.893492 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.893708 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.893797 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.894021 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.894108 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.894325 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.894414 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.894625 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.894714 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.894920 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.895008 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.895256 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.895359 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.895559 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.895660 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.895857 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.895986 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.896156 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.896315 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.896456 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.896623 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.896761 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.896931 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.897059 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.897236 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.897357 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.897549 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.897657 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.897868 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.897956 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.898179 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.898269 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.898487 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.898622 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.898799 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.898888 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.899096 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.899210 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.899419 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.899509 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.899720 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.899824 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.900021 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.900110 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.900317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.900405 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.900623 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.900719 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.900925 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.901033 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.901365 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.901475 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.901688 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.901871 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.901998 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.902184 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.902316 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.902492 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.902623 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.902800 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.902941 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.903159 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.903288 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.903446 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.903581 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.903754 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.903889 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.904061 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.904218 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.904370 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.904525 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.904674 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.904830 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.905007 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.905140 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.905340 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.905438 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.905657 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.905746 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.905981 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.906076 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.906296 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.906386 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.906619 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.906715 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.906930 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.907017 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.907274 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.907369 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.907590 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.907678 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.907906 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.908005 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.908216 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.908304 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.908520 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.908607 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.908845 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.908935 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.909151 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.909251 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.909460 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.909554 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.909768 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.909863 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.910075 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.910216 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.910381 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.910470 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.910695 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.910792 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.911007 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.911097 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.911342 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.911432 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.911666 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.911765 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.911974 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.912062 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.912295 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.912390 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.912612 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.912702 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.912927 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.913016 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.913250 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.913337 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.913565 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.913654 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.913877 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.913971 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.914199 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.914291 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.914504 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.914593 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.914806 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.914894 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.915053 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 15:10:00.915150 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.915454 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.915780 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.916106 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.916419 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.917358 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.918104 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.918461 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.918782 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.919133 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.919497 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.919816 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.920136 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.920445 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:10:00.920691 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 15:10:00.984493 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO dbcounter [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Registered counter for database nova_api Jun 24 15:10:01.069456 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO dbcounter [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Registered counter for database nova_api Jun 24 15:10:01.093661 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_db.sqlalchemy.engines [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.098937 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writer thread running {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.099496 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.106483 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writer thread running {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.157705 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.context [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780(cell1) {{(pid=103763) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 15:10:01.161577 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:10:01.162460 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.context [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780(cell1) {{(pid=103762) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 15:10:01.163159 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:10:01.163963 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:10:01.165930 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:10:01.166382 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_concurrency.lockutils [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:10:01.168883 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_concurrency.lockutils [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:10:01.168991 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO dbcounter [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Registered counter for database nova_cell0 Jun 24 15:10:01.169668 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_concurrency.lockutils [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:10:01.171748 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_concurrency.lockutils [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:10:01.173118 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO dbcounter [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Registered counter for database nova_cell1 Jun 24 15:10:01.173713 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO dbcounter [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Registered counter for database nova_cell0 Jun 24 15:10:01.178267 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO dbcounter [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Registered counter for database nova_cell1 Jun 24 15:10:01.180062 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_db.sqlalchemy.engines [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.182349 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_db.sqlalchemy.engines [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.185566 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.187382 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writer thread running {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.189166 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.191758 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writer thread running {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.192746 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writer thread running {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.336477 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writer thread running {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.337064 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO dbcounter [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Registered counter for database nova_cell0 Jun 24 15:10:01.345975 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO dbcounter [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Registered counter for database nova_cell0 Jun 24 15:10:01.346202 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_db.sqlalchemy.engines [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.350534 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writer thread running {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.352677 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:10:01.357095 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writer thread running {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:10:01.776790 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: WARNING keystonemiddleware.auth_token [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:10:01.784219 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: WARNING keystonemiddleware.auth_token [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:10:01.794052 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: WARNING keystonemiddleware.auth_token [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:10:01.801659 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: WARNING keystonemiddleware.auth_token [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:10:02.124048 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: WARNING keystonemiddleware.auth_token [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:10:02.130030 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: WARNING keystonemiddleware.auth_token [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:10:02.135814 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e2ccec9c0 pid: 103763 (default app) Jun 24 15:10:02.138053 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:10:02.139258 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Jun 24 15:10:02.139675 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Fri Jun 24 15:10:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:10:02.140829 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: WARNING keystonemiddleware.auth_token [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:10:02.146876 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: WARNING keystonemiddleware.auth_token [None req-a9b14cbb-a620-4716-a0da-e658fd06b06f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:10:02.152517 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555e2ccec9c0 pid: 103762 (default app) Jun 24 15:11:19.985265 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:19.986878 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Jun 24 15:11:19.987321 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:20.004203 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writing DB stats nova_api:SELECT=3 {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:20.005138 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writing DB stats nova_cell0:SELECT=3 {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:20.006210 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writing DB stats nova_cell1:SELECT=3 {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:20.007019 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:20.447976 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-2c708784-cc09-4507-8613-6c41308ad206 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:20.478851 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-2c708784-cc09-4507-8613-6c41308ad206 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.484653 Jun 24 15:11:20.479895 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1291 bytes} [Fri Jun 24 15:11:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:11:22.560440 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:22.561433 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-fad35f9d-afd2-4ab4-9155-e684b734b1b0 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 24 15:11:22.561834 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:22.629880 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-f50b12c6-a34e-4839-b842-9270ed100195 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:22.648093 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:11:22.648093 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: warnings.warn(msg) Jun 24 15:11:22.761744 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-f50b12c6-a34e-4839-b842-9270ed100195 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.193641 Jun 24 15:11:22.769842 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:11:22.778117 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_api:SELECT=3 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:22.779450 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_cell0:SELECT=3 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:22.780945 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_cell1:SELECT=3 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:22.781781 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:22.989980 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-280397d3-f6e7-4e56-a7cf-222f04b7552c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:22.992309 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:11:22.992309 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: warnings.warn(msg) Jun 24 15:11:23.132930 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-280397d3-f6e7-4e56-a7cf-222f04b7552c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361619 Jun 24 15:11:23.133826 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1335 bytes} [Fri Jun 24 15:11:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:11:25.243853 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-f50b12c6-a34e-4839-b842-9270ed100195 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:25.244882 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-f50b12c6-a34e-4839-b842-9270ed100195 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 24 15:11:25.245276 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:25.353473 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-a92f7c92-0fea-4978-b767-3826a143676e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:25.372815 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:11:25.372815 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: warnings.warn(msg) Jun 24 15:11:25.452381 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-a92f7c92-0fea-4978-b767-3826a143676e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.200929 Jun 24 15:11:25.453219 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:11:25.466005 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-5555be8a-7664-4ae1-89df-7b555982d7fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:25.467537 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:11:25.467537 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: warnings.warn(msg) Jun 24 15:11:25.552612 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-5555be8a-7664-4ae1-89df-7b555982d7fc admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091234 Jun 24 15:11:25.553188 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1335 bytes} [Fri Jun 24 15:11:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:11:27.652204 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-a92f7c92-0fea-4978-b767-3826a143676e admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:27.653535 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-a92f7c92-0fea-4978-b767-3826a143676e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Jun 24 15:11:27.653947 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:27.714032 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-ead194ca-28f0-4efe-821b-833ec3356408 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:27.901599 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-ead194ca-28f0-4efe-821b-833ec3356408 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.240943 Jun 24 15:11:27.902344 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:11:27.914405 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-c9b24e40-8229-4b60-b10a-cd51609a8f86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:27.998238 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-c9b24e40-8229-4b60-b10a-cd51609a8f86 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087543 Jun 24 15:11:27.999044 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1335 bytes} [Fri Jun 24 15:11:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:11:30.106481 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-ead194ca-28f0-4efe-821b-833ec3356408 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:30.107640 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-ead194ca-28f0-4efe-821b-833ec3356408 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 24 15:11:30.108123 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:30.168348 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-fd9a09dc-2101-405f-8a14-28d090829adc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:30.244817 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-fd9a09dc-2101-405f-8a14-28d090829adc admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130668 Jun 24 15:11:30.245371 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:11:30.257084 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-29813ea7-5317-4445-97fe-2c45ae72054e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:30.344619 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-29813ea7-5317-4445-97fe-2c45ae72054e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090997 Jun 24 15:11:30.345177 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1335 bytes} [Fri Jun 24 15:11:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:11:32.453681 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-fd9a09dc-2101-405f-8a14-28d090829adc admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:32.455294 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-fd9a09dc-2101-405f-8a14-28d090829adc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Jun 24 15:11:32.455875 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:32.517779 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-3110b4eb-8855-4d4c-8974-584668cf26e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:32.622705 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-3110b4eb-8855-4d4c-8974-584668cf26e5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160728 Jun 24 15:11:32.624119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:11:32.635616 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-c8130549-1e01-4c66-8f0a-545d132b4ac9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:32.723428 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-c8130549-1e01-4c66-8f0a-545d132b4ac9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091716 Jun 24 15:11:32.724105 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1335 bytes} [Fri Jun 24 15:11:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:11:34.821434 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-3110b4eb-8855-4d4c-8974-584668cf26e5 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:34.823043 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-3110b4eb-8855-4d4c-8974-584668cf26e5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Jun 24 15:11:34.827478 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:34.883936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-6d8aba47-0185-49bb-b620-6bb6488cb694 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:34.907524 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-6d8aba47-0185-49bb-b620-6bb6488cb694 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077745 Jun 24 15:11:34.908072 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1291 bytes} [Fri Jun 24 15:11:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:11:37.054628 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-3110b4eb-8855-4d4c-8974-584668cf26e5 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:37.055839 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-3110b4eb-8855-4d4c-8974-584668cf26e5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Jun 24 15:11:37.056313 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:37.127728 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-89cac4a4-d719-48a3-8dee-e83caf69bd05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "id": "1"}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:37.206812 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-89cac4a4-d719-48a3-8dee-e83caf69bd05 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.143265 Jun 24 15:11:37.209329 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:11:37.220792 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-76556cdb-1e1e-4eab-8ad0-e0305528b494 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:37.328469 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-76556cdb-1e1e-4eab-8ad0-e0305528b494 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111984 Jun 24 15:11:37.329242 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1332 bytes} [Fri Jun 24 15:11:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:11:39.443906 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-89cac4a4-d719-48a3-8dee-e83caf69bd05 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:39.444925 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-89cac4a4-d719-48a3-8dee-e83caf69bd05 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 24 15:11:39.445315 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:39.508923 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-ca780de5-aec0-4cb1-974c-4548c708c78d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:39.593135 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-ca780de5-aec0-4cb1-974c-4548c708c78d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140877 Jun 24 15:11:39.593696 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:11:39.606382 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-fffd1f9a-cb65-446d-9974-fc948bdaf971 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:39.683693 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-fffd1f9a-cb65-446d-9974-fc948bdaf971 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081262 Jun 24 15:11:39.684425 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1332 bytes} [Fri Jun 24 15:11:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:11:42.311568 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-ca780de5-aec0-4cb1-974c-4548c708c78d admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:42.312598 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-ca780de5-aec0-4cb1-974c-4548c708c78d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 24 15:11:42.313181 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:42.373044 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-82fd88a4-460c-47c3-8420-dc3539322009 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:42.460123 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-82fd88a4-460c-47c3-8420-dc3539322009 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.141048 Jun 24 15:11:42.467969 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:11:42.473195 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-3d919435-4e81-4aa1-9f94-06d2a7824d3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:42.585711 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-3d919435-4e81-4aa1-9f94-06d2a7824d3f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116335 Jun 24 15:11:42.586297 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1332 bytes} [Fri Jun 24 15:11:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:11:44.713211 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-82fd88a4-460c-47c3-8420-dc3539322009 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:44.714274 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-82fd88a4-460c-47c3-8420-dc3539322009 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jun 24 15:11:44.714703 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:44.773968 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-5d554db6-d4bc-4548-8af2-cbff62c87d3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:44.868217 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-5d554db6-d4bc-4548-8af2-cbff62c87d3a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146977 Jun 24 15:11:44.869297 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:11:44.881572 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-39f41367-769d-482e-9653-1310eff84baf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:44.979881 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-39f41367-769d-482e-9653-1310eff84baf admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102120 Jun 24 15:11:44.980463 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1332 bytes} [Fri Jun 24 15:11:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:11:47.165294 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-5d554db6-d4bc-4548-8af2-cbff62c87d3a admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:11:47.168302 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-5d554db6-d4bc-4548-8af2-cbff62c87d3a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003596 Jun 24 15:11:47.168785 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:11:47.233111 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-0a8e70b6-9ca2-4fff-809a-2add0eea8319 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:47.462192 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-0a8e70b6-9ca2-4fff-809a-2add0eea8319 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.286811 Jun 24 15:11:47.462893 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1282 bytes} [Fri Jun 24 15:11:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:11:47.474875 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-d59d3a9e-316d-4bde-b4e1-acd12951ee77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:11:47.559268 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-d59d3a9e-316d-4bde-b4e1-acd12951ee77 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088096 Jun 24 15:11:47.560234 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1332 bytes} [Fri Jun 24 15:11:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:12:12.336201 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-0a8e70b6-9ca2-4fff-809a-2add0eea8319 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:12.337687 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-0a8e70b6-9ca2-4fff-809a-2add0eea8319 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jun 24 15:12:12.338077 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:12:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:12.352334 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:12:12.397597 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-4e37622a-6ddf-4c85-84d2-4e833b6d9553 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:12.416066 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-4e37622a-6ddf-4c85-84d2-4e833b6d9553 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071729 Jun 24 15:12:12.416598 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1291 bytes} [Fri Jun 24 15:12:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:12:13.324038 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-0a8e70b6-9ca2-4fff-809a-2add0eea8319 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:13.325039 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-0a8e70b6-9ca2-4fff-809a-2add0eea8319 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 24 15:12:13.325432 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:13.512007 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-97ea19a1-5f62-4699-9e1b-1ce5a9cb5756 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:13.517557 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.wsgi [None req-97ea19a1-5f62-4699-9e1b-1ce5a9cb5756 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-97ea19a1-5f62-4699-9e1b-1ce5a9cb5756 admin admin] Request method failure captured: Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Accept: application/json Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Accept-Encoding: gzip, deflate Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Connection: keep-alive Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Content-Length: 0 Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Host: 10.222.0.67 Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Openstack-Api-Version: compute 2.90 Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Openstack-System-Scope: None Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: User-Agent: python-novaclient Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Auth-Token: gAAAAABitdRNgS9zYfWD8JI5cY_8qthkkq580xDfPQVs-GfCE_BeifIX676VTb_szusYMK6LP1iSo6M_KskUG-rIyk0-Ob7RMvAd2ZI2p7yMLlWIe13_C67GTpS2WTXeUBpRtqAUTZ9TtSEKcdM7xMQj3qBHQK8VAWscC2sQX6oIWocj_YE6XnU Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Domain-Id: None Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Domain-Name: None Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Identity-Status: Confirmed Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Is-Admin-Project: True Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Domain-Id: default Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Domain-Name: Default Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Name: admin Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Role: member,admin,reader Jun 24 15:12:13.520911 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Roles: member,admin,reader Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e36bcd54fa5438c93e449d16bda5ca3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant: admin Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant-Name: admin Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User: admin Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Domain-Id: default Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Domain-Name: Default Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Id: 4f372b5546df46a8836cf73269458aff Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Name: admin Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: method: > Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: exception: Flavor 42 could not be found. Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: action_args: {'id': '42'} Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:12:13.522606 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:13.523594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.525119 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-97ea19a1-5f62-4699-9e1b-1ce5a9cb5756 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:12:13.526208 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-97ea19a1-5f62-4699-9e1b-1ce5a9cb5756 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061908 Jun 24 15:12:13.526208 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Jun 24 15:12:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 15:12:13.532626 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-0b225775-8093-4aca-9b4d-12be56c2f869 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:13.535584 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:12:13.554318 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-0b225775-8093-4aca-9b4d-12be56c2f869 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025291 Jun 24 15:12:13.554848 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Jun 24 15:12:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:12:13.565276 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-7c3b9cc8-9fc2-4288-899b-2b55d36d9fad admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:13.586236 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-7c3b9cc8-9fc2-4288-899b-2b55d36d9fad admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024493 Jun 24 15:12:13.586770 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Jun 24 15:12:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:12:13.596031 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-aebf2175-7121-4027-9054-ab0b9e29a1c7 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:13.602095 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.wsgi [None req-aebf2175-7121-4027-9054-ab0b9e29a1c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-aebf2175-7121-4027-9054-ab0b9e29a1c7 admin admin] Request method failure captured: Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Accept: application/json Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Accept-Encoding: gzip, deflate Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Connection: keep-alive Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Content-Length: 0 Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Host: 10.222.0.67 Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Openstack-Api-Version: compute 2.90 Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Openstack-System-Scope: None Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: User-Agent: python-novaclient Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Auth-Token: gAAAAABitdRNgS9zYfWD8JI5cY_8qthkkq580xDfPQVs-GfCE_BeifIX676VTb_szusYMK6LP1iSo6M_KskUG-rIyk0-Ob7RMvAd2ZI2p7yMLlWIe13_C67GTpS2WTXeUBpRtqAUTZ9TtSEKcdM7xMQj3qBHQK8VAWscC2sQX6oIWocj_YE6XnU Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Domain-Id: None Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Domain-Name: None Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Identity-Status: Confirmed Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Is-Admin-Project: True Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Domain-Id: default Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Domain-Name: Default Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Name: admin Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Role: member,admin,reader Jun 24 15:12:13.605913 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Roles: member,admin,reader Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e36bcd54fa5438c93e449d16bda5ca3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant: admin Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant-Name: admin Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User: admin Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Domain-Id: default Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Domain-Name: Default Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Id: 4f372b5546df46a8836cf73269458aff Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Name: admin Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: method: > Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: exception: Flavor 42 could not be found. Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: action_args: {'id': '42'} Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:12:13.607636 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:13.608499 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:13.609844 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-aebf2175-7121-4027-9054-ab0b9e29a1c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:12:13.611021 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-aebf2175-7121-4027-9054-ab0b9e29a1c7 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014774 Jun 24 15:12:13.611021 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Jun 24 15:12:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:14.437506 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-7c3b9cc8-9fc2-4288-899b-2b55d36d9fad admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:14.438516 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-7c3b9cc8-9fc2-4288-899b-2b55d36d9fad admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 24 15:12:14.438908 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:14.633315 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-ab382652-9abd-473e-8fe4-14632560993b admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:14.638883 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.wsgi [None req-ab382652-9abd-473e-8fe4-14632560993b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-ab382652-9abd-473e-8fe4-14632560993b admin admin] Request method failure captured: Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Accept: application/json Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Accept-Encoding: gzip, deflate Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Connection: keep-alive Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Content-Length: 0 Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Host: 10.222.0.67 Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Openstack-Api-Version: compute 2.90 Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Openstack-System-Scope: None Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: User-Agent: python-novaclient Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Auth-Token: gAAAAABitdROpVd0L6H_6P12meRk9Tfuh6gv7Ilb6WN-SUNT91Jplh7YzSbRmDWExXMjobUmQ7qwLMTxcaKBYv-ZlwflXeUleu0g44zq_wMRn-NpSAi6wdKYHi7tZKHk8Yhg0K9MAd4BlETv-jz5IhO9KFX8rKl6vyz_1TeKugLINHyqENg3TGg Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Domain-Id: None Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Domain-Name: None Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Identity-Status: Confirmed Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Is-Admin-Project: True Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Domain-Id: default Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Domain-Name: Default Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Name: admin Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Role: member,admin,reader Jun 24 15:12:14.640528 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Roles: member,admin,reader Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e36bcd54fa5438c93e449d16bda5ca3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant: admin Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant-Name: admin Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User: admin Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Domain-Id: default Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Domain-Name: Default Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Id: 4f372b5546df46a8836cf73269458aff Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Name: admin Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: method: > Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: exception: Flavor 84 could not be found. Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: action_args: {'id': '84'} Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:12:14.642161 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:14.643497 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.644901 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-ab382652-9abd-473e-8fe4-14632560993b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:12:14.646189 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-ab382652-9abd-473e-8fe4-14632560993b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062997 Jun 24 15:12:14.646189 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Jun 24 15:12:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:14.652704 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-64c1aa99-2bf8-42db-aa3b-d70463bffcb4 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:14.667032 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-64c1aa99-2bf8-42db-aa3b-d70463bffcb4 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019120 Jun 24 15:12:14.667594 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Jun 24 15:12:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:12:14.677085 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-c03f2b5c-5669-4b4c-9cf8-70a1449bd487 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:14.692525 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-c03f2b5c-5669-4b4c-9cf8-70a1449bd487 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018919 Jun 24 15:12:14.693053 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Jun 24 15:12:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:12:14.709467 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-5524967c-fc62-4515-ae10-cc5c25ff174a admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:14.715654 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.wsgi [None req-5524967c-fc62-4515-ae10-cc5c25ff174a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-5524967c-fc62-4515-ae10-cc5c25ff174a admin admin] Request method failure captured: Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Accept: application/json Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Accept-Encoding: gzip, deflate Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Connection: keep-alive Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Content-Length: 0 Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Host: 10.222.0.67 Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Openstack-Api-Version: compute 2.90 Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Openstack-System-Scope: None Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: User-Agent: python-novaclient Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Auth-Token: gAAAAABitdROpVd0L6H_6P12meRk9Tfuh6gv7Ilb6WN-SUNT91Jplh7YzSbRmDWExXMjobUmQ7qwLMTxcaKBYv-ZlwflXeUleu0g44zq_wMRn-NpSAi6wdKYHi7tZKHk8Yhg0K9MAd4BlETv-jz5IhO9KFX8rKl6vyz_1TeKugLINHyqENg3TGg Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Domain-Id: None Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Domain-Name: None Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Identity-Status: Confirmed Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Is-Admin-Project: True Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Domain-Id: default Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Domain-Name: Default Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Name: admin Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Role: member,admin,reader Jun 24 15:12:14.717161 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Roles: member,admin,reader Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e36bcd54fa5438c93e449d16bda5ca3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant: admin Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant-Name: admin Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User: admin Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Domain-Id: default Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Domain-Name: Default Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Id: 4f372b5546df46a8836cf73269458aff Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Name: admin Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: method: > Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: exception: Flavor 84 could not be found. Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: action_args: {'id': '84'} Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:12:14.718791 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:14.719719 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:14.721077 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-5524967c-fc62-4515-ae10-cc5c25ff174a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:12:14.722354 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-5524967c-fc62-4515-ae10-cc5c25ff174a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012661 Jun 24 15:12:14.722354 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Fri Jun 24 15:12:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:15.529827 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-c03f2b5c-5669-4b4c-9cf8-70a1449bd487 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:15.530825 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-c03f2b5c-5669-4b4c-9cf8-70a1449bd487 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 24 15:12:15.531237 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:15.719883 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-998be47a-a3f9-4e73-9b08-7448230f2739 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:15.725172 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.wsgi [None req-998be47a-a3f9-4e73-9b08-7448230f2739 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-998be47a-a3f9-4e73-9b08-7448230f2739 admin admin] Request method failure captured: Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Accept: application/json Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Accept-Encoding: gzip, deflate Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Connection: keep-alive Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Content-Length: 0 Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Host: 10.222.0.67 Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Openstack-Api-Version: compute 2.90 Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Openstack-System-Scope: None Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: User-Agent: python-novaclient Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Auth-Token: gAAAAABitdRP65VckAWmU4Raa_YzlCcVK6ZKQXZhRtcdMiDaXZy4210BaYb_E2v9qWTteKhE2oVFvk8r8ojKAqVk2IsZf6zocwBi50Bi3m54-RPXyLRQCXO1hCUihZ2vvmZsv5cHJpXvcOZymS6ir-C3zGupWBdIaidDuA3q8mdAorayDDqaEIE Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Domain-Id: None Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Domain-Name: None Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Identity-Status: Confirmed Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Is-Admin-Project: True Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Domain-Id: default Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Domain-Name: Default Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Project-Name: admin Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Role: member,admin,reader Jun 24 15:12:15.726636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Roles: member,admin,reader Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e36bcd54fa5438c93e449d16bda5ca3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant: admin Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-Tenant-Name: admin Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User: admin Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Domain-Id: default Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Domain-Name: Default Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Id: 4f372b5546df46a8836cf73269458aff Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: X-User-Name: admin Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: method: > Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: exception: Flavor 451 could not be found. Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: action_args: {'id': '451'} Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:12:15.731269 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:15.732266 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.733451 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-998be47a-a3f9-4e73-9b08-7448230f2739 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:12:15.734527 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-998be47a-a3f9-4e73-9b08-7448230f2739 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060216 Jun 24 15:12:15.734527 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Jun 24 15:12:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:15.738746 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-fb511af9-8d01-4862-8659-b4328b227161 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:15.753382 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-fb511af9-8d01-4862-8659-b4328b227161 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018143 Jun 24 15:12:15.753840 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Jun 24 15:12:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:12:15.764046 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:15.777628 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017514 Jun 24 15:12:15.778152 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Fri Jun 24 15:12:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:12:15.787262 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-c9aa90f0-1de0-4c4a-b2ef-502b479d37ae admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:15.792840 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.wsgi [None req-c9aa90f0-1de0-4c4a-b2ef-502b479d37ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-c9aa90f0-1de0-4c4a-b2ef-502b479d37ae admin admin] Request method failure captured: Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Accept: application/json Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Accept-Encoding: gzip, deflate Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Connection: keep-alive Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Content-Length: 0 Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Host: 10.222.0.67 Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Openstack-Api-Version: compute 2.90 Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Openstack-System-Scope: None Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: User-Agent: python-novaclient Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Auth-Token: gAAAAABitdRP65VckAWmU4Raa_YzlCcVK6ZKQXZhRtcdMiDaXZy4210BaYb_E2v9qWTteKhE2oVFvk8r8ojKAqVk2IsZf6zocwBi50Bi3m54-RPXyLRQCXO1hCUihZ2vvmZsv5cHJpXvcOZymS6ir-C3zGupWBdIaidDuA3q8mdAorayDDqaEIE Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Domain-Id: None Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Domain-Name: None Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Identity-Status: Confirmed Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Is-Admin-Project: True Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Domain-Id: default Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Domain-Name: Default Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Project-Name: admin Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Role: member,admin,reader Jun 24 15:12:15.794317 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Roles: member,admin,reader Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e36bcd54fa5438c93e449d16bda5ca3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e36bcd54fa5438c93e449d16bda5ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant: admin Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant-Id: 4e36bcd54fa5438c93e449d16bda5ca3 Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-Tenant-Name: admin Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User: admin Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Domain-Id: default Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Domain-Name: Default Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Id: 4f372b5546df46a8836cf73269458aff Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: X-User-Name: admin Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: method: > Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: exception: Flavor 451 could not be found. Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: action_args: {'id': '451'} Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:12:15.795954 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:15.796936 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: ERROR nova.api.openstack.wsgi Jun 24 15:12:15.798289 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-c9aa90f0-1de0-4c4a-b2ef-502b479d37ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:12:15.799595 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-c9aa90f0-1de0-4c4a-b2ef-502b479d37ae admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011895 Jun 24 15:12:15.799595 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Jun 24 15:12:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:16.636824 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:16.637837 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 24 15:12:16.638236 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:16.826513 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-0a544a12-d06a-48f2-8d34-c867dc723207 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:12:16.883264 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-0a544a12-d06a-48f2-8d34-c867dc723207 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.108123 Jun 24 15:12:16.883884 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Jun 24 15:12:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:12:17.701702 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:17.702703 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 24 15:12:17.703103 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:12:17.892110 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-30b64df6-1dc9-4457-9fc8-56c6ec2fb7ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:12:17.945443 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-30b64df6-1dc9-4457-9fc8-56c6ec2fb7ae admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.103570 Jun 24 15:12:17.946451 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Jun 24 15:12:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:12:18.774631 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:18.775681 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Jun 24 15:12:18.776076 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:18.966662 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-d9d05256-1276-4516-b4ec-b00ad5a8c020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:12:19.048812 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-d9d05256-1276-4516-b4ec-b00ad5a8c020 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.133006 Jun 24 15:12:19.049282 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Jun 24 15:12:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:12:19.881800 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:19.882806 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 24 15:12:19.883233 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:20.073067 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-210e3f77-fd94-4d45-923c-44f2bbb22491 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:12:20.129592 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-210e3f77-fd94-4d45-923c-44f2bbb22491 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.108096 Jun 24 15:12:20.130132 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Fri Jun 24 15:12:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:12:20.957632 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:20.958636 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 24 15:12:20.959031 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:12:21.148358 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-f6cbb3c7-09cc-415a-9514-014a0445c315 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:12:21.167758 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-f6cbb3c7-09cc-415a-9514-014a0445c315 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071450 Jun 24 15:12:21.168286 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Fri Jun 24 15:12:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:13:08.199310 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:13:08.200329 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-861b163e-3e4c-477c-a3de-8e3e56bb0b22 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 24 15:13:08.200725 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 930 bytes} [Fri Jun 24 15:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:13:08.211581 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:13:08.258332 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-3019a82a-ad83-4dd0-8906-da79c14ce7cc admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:13:08.278363 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-3019a82a-ad83-4dd0-8906-da79c14ce7cc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071770 Jun 24 15:13:08.278894 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1291 bytes} [Fri Jun 24 15:13:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:13:08.301728 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-512d5e9a-0c27-44be-9396-f25a5aae6e5c admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:13:08.305473 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG dbcounter [-] [103762] Writing DB stats nova_api:SELECT=14 {{(pid=103762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:13:08.310433 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-512d5e9a-0c27-44be-9396-f25a5aae6e5c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012314 Jun 24 15:13:08.310951 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1282 bytes} [Fri Jun 24 15:13:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:13:08.323172 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-4ed7b736-16f4-4a68-a3d9-937e32e7fa2f admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:13:08.330733 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-4ed7b736-16f4-4a68-a3d9-937e32e7fa2f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011959 Jun 24 15:13:08.331271 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1285 bytes} [Fri Jun 24 15:13:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:13:08.343290 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:13:08.351424 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011689 Jun 24 15:13:08.351873 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1285 bytes} [Fri Jun 24 15:13:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:13:08.362714 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-4f308bc1-cadc-4e9c-bd29-235d31754ee8 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:13:08.370739 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-4f308bc1-cadc-4e9c-bd29-235d31754ee8 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011487 Jun 24 15:13:08.371274 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1282 bytes} [Fri Jun 24 15:13:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:16:32.097483 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:32.098528 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 24 15:16:32.098915 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:16:32.241582 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_api:SELECT=6 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:16:32.356640 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-d70c87e7-974c-4d15-80db-22e80128be8c admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:32.357803 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:16:32.357803 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: warnings.warn(msg) Jun 24 15:16:32.359056 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-d70c87e7-974c-4d15-80db-22e80128be8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:32.359570 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-d70c87e7-974c-4d15-80db-22e80128be8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:32.360427 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-d70c87e7-974c-4d15-80db-22e80128be8c admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:32.360878 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-d70c87e7-974c-4d15-80db-22e80128be8c admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:32.395376 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-d70c87e7-974c-4d15-80db-22e80128be8c admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.155164 Jun 24 15:16:32.395960 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Jun 24 15:16:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:16:33.224208 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:33.225730 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Jun 24 15:16:33.225730 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:16:33.414500 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-13693f6d-fea2-4936-b68c-61fa29222ce7 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:33.415757 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:16:33.415757 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: warnings.warn(msg) Jun 24 15:16:33.416914 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-13693f6d-fea2-4936-b68c-61fa29222ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:33.417342 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-13693f6d-fea2-4936-b68c-61fa29222ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:33.418109 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-13693f6d-fea2-4936-b68c-61fa29222ce7 admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:33.418526 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-13693f6d-fea2-4936-b68c-61fa29222ce7 admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:33.437523 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-13693f6d-fea2-4936-b68c-61fa29222ce7 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074594 Jun 24 15:16:33.438058 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Jun 24 15:16:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:16:44.710983 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:44.712059 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 24 15:16:44.712461 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:16:44.858855 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_cell0:SELECT=4 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:16:44.859617 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_cell1:SELECT=4 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:16:44.860240 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG dbcounter [-] [103763] Writing DB stats nova_api:SELECT=8 {{(pid=103763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:16:44.909140 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-28c59c3e-ae72-46d3-aca8-1e14ce124c9f admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:44.910267 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:16:44.910267 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: warnings.warn(msg) Jun 24 15:16:44.912136 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-28c59c3e-ae72-46d3-aca8-1e14ce124c9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:44.912840 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-28c59c3e-ae72-46d3-aca8-1e14ce124c9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:44.913634 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-28c59c3e-ae72-46d3-aca8-1e14ce124c9f admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:44.914070 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-28c59c3e-ae72-46d3-aca8-1e14ce124c9f admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:44.943485 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-28c59c3e-ae72-46d3-aca8-1e14ce124c9f admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085688 Jun 24 15:16:44.943485 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 38/74] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Jun 24 15:16:44 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:16:45.765310 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: DEBUG nova.api.openstack.wsgi [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] Calling method '>' {{(pid=103762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:45.766356 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: INFO nova.api.openstack.requestlog [None req-d3446eec-40c2-4e14-83e9-4e86d88c27d8 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 24 15:16:45.766758 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: [pid: 103762|app: 0|req: 37/75] 10.222.0.67 () {56 vars in 1074 bytes} [Fri Jun 24 15:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:16:45.962501 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG nova.api.openstack.wsgi [None req-0a18f182-ec26-4d5d-8ef0-18d79d387c78 admin admin] Calling method '>' {{(pid=103763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:16:45.963713 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:16:45.963713 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: warnings.warn(msg) Jun 24 15:16:45.965101 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-0a18f182-ec26-4d5d-8ef0-18d79d387c78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:45.965542 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-0a18f182-ec26-4d5d-8ef0-18d79d387c78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:45.966323 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-0a18f182-ec26-4d5d-8ef0-18d79d387c78 admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:16:45.966780 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: DEBUG oslo_concurrency.lockutils [None req-0a18f182-ec26-4d5d-8ef0-18d79d387c78 admin admin] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:16:45.988402 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: INFO nova.api.openstack.requestlog [None req-0a18f182-ec26-4d5d-8ef0-18d79d387c78 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078315 Jun 24 15:16:45.988873 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: [pid: 103763|app: 0|req: 39/76] 10.222.0.67 () {60 vars in 1193 bytes} [Fri Jun 24 15:16:45 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:17:42.165517 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: Fri Jun 24 15:17:42 2022 - graceful shutdown triggered... Jun 24 15:17:42.166011 dv-cinder-835384-11-iscsi devstack@n-api.service[103763]: Gracefully killing worker 2 (pid: 103763)... Jun 24 15:17:42.165641 dv-cinder-835384-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 15:17:42.166868 dv-cinder-835384-11-iscsi devstack@n-api.service[103762]: Gracefully killing worker 1 (pid: 103762)... Jun 24 15:17:43.166663 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: worker 1 buried after 1 seconds Jun 24 15:17:43.167087 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: worker 2 buried after 1 seconds Jun 24 15:17:43.167087 dv-cinder-835384-11-iscsi devstack@n-api.service[103761]: goodbye to uWSGI. Jun 24 15:17:43.168311 dv-cinder-835384-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 15:17:43.168852 dv-cinder-835384-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 15:17:43.171727 dv-cinder-835384-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 15:17:43.181841 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 15:17:43 2022] *** Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: nodename: dv-cinder-835384-11-iscsi Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: machine: x86_64 Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: clock source: unix Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: pcre jit disabled Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: detected number of CPU cores: 4 Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: current working directory: / Jun 24 15:17:43.183904 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: detected binary path: /usr/bin/uwsgi-core Jun 24 15:17:43.184645 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: your processes number limit is 47680 Jun 24 15:17:43.184645 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: your memory page size is 4096 bytes Jun 24 15:17:43.184645 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: detected max file descriptor number: 2048 Jun 24 15:17:43.184645 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: lock engine: pthread robust mutexes Jun 24 15:17:43.184645 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: thunder lock: enabled Jun 24 15:17:43.184645 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 15:17:43.184645 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 15:17:43.231051 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: Python main interpreter initialized at 0x55ab17b3e9c0 Jun 24 15:17:43.231051 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: python threads support enabled Jun 24 15:17:43.231051 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: your server socket listen backlog is limited to 100 connections Jun 24 15:17:43.231051 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: your mercy for graceful operations on workers is 90 seconds Jun 24 15:17:43.231497 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 15:17:43.231571 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: *** Operational MODE: preforking *** Jun 24 15:17:43.231852 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: *** uWSGI is running in multiple interpreter mode *** Jun 24 15:17:43.231852 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: spawned uWSGI master process (pid: 118256) Jun 24 15:17:43.232063 dv-cinder-835384-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 15:17:43.235739 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: spawned uWSGI worker 1 (pid: 118273, cores: 1) Jun 24 15:17:43.238031 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: spawned uWSGI worker 2 (pid: 118274, cores: 1) Jun 24 15:17:43.238236 dv-cinder-835384-11-iscsi devstack@n-api.service[118256]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 15:17:43.898093 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 15:17:43.908153 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 15:17:45.106193 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:17:45.106193 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: from cryptography.utils import int_from_bytes Jun 24 15:17:45.106748 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:17:45.106748 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: from cryptography.utils import int_from_bytes Jun 24 15:17:45.117781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:17:45.117781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: from cryptography.utils import int_from_bytes Jun 24 15:17:45.118376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 15:17:45.118376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: from cryptography.utils import int_from_bytes Jun 24 15:17:47.483483 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 15:17:47.484088 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 15:17:47.484273 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 15:17:47.484637 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 15:17:47.484892 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 15:17:47.485278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.485606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.485925 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.486256 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.486571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.486880 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.487218 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.487535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.487866 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.488125 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.488437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.488758 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-11-iscsi {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.489080 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.489386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.489691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.490008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.490310 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.490629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.491085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.491725 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.493271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.493271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.493271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.493271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.493593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.493684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.493985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.494304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.494618 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.494929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.495376 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-11-iscsi {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.495696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.496009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.496325 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.496745 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.497059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.497357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.497675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.498001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.498319 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.498637 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.498943 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.499318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.499597 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.499910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.500205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.500516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.500831 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.501136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.501440 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.501695 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.501999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.502320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.502645 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.502964 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.503234 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.503484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.503798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.504117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.504424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.504733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.505036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.505342 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.505599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 15:17:47.507718 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.507817 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 15:17:47.507901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.507901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508053 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 15:17:47.508133 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 15:17:47.508299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 15:17:47.508486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508656 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508729 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508806 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508885 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.508969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.509047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.509251 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.509351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.509529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.509623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.509842 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.509946 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.510176 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.510276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.510491 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.510589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.510748 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.510838 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.511060 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.511142 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.511419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-11-iscsi {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.511519 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.511731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.511820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.512038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.512131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.512346 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.512435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.512665 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.512754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.512968 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.513056 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.513288 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.513386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.513537 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.513629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.513839 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.514086 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.514195 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.514401 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.514490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.514706 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.515438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.515605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.515792 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.515792 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.516088 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.516238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.516382 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.516549 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.516702 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.516845 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.516989 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.517153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.517296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.517454 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.517604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.517746 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.517888 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.518031 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.518186 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-11-iscsi {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.518337 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.518499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.518653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.518806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.518956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.519117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.519318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.519475 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.519639 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.519798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.519942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.519942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.520257 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.520419 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.520563 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.520718 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.520869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.520869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.521148 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.521300 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.521443 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.521594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.521743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.521893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.522044 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.522812 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.522977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.523664 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.523822 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.523967 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.524122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.524283 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.524428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.524571 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.524721 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.524873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.525025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.525186 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.525340 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.525495 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.525638 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.525788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.525951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526095 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526244 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526389 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526689 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526988 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.526988 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.527313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.527471 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.527698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.527698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.527983 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.528136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.528279 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.528422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.528580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.528723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.528866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.529008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.529169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.529313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.529464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.529620 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.529772 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.529922 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.530065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.530225 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.530378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.530532 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.530677 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.530677 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.530960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.531123 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.531304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.531458 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.531610 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.531762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.531905 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.531905 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.532204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.532204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.532483 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.532635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.533035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.533208 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.533385 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.533883 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.534043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.534188 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.534331 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.534483 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.534627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.534779 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.534922 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.535074 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.535267 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.535419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.535573 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.535724 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.535868 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.536010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.536162 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.536312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.536463 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.536616 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.536767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.536911 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.537063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.537213 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.537376 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.537521 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.537671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.537904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.538069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.538222 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.538373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.538524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.538667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.538819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.538971 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.539116 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.539283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.539450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.539450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.539742 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.539893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.540044 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.540191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.540191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.540460 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.540611 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.540761 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.540905 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.541056 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.541205 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.541366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.541524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.541679 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.541830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.541980 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.542131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.542288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.542432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.542574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.542715 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.542865 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.543009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.543167 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.543347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.543490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.543490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.544146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.544299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.544453 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.544603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.544755 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.544908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.545058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.545210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.545360 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.545504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.545658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.545815 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.545959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.546113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.546265 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.546416 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.546567 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.546731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.546897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.547052 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.547226 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.547388 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.547551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.547710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.547983 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.548155 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.548302 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.548445 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.548595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.548739 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.548891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.549035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.549178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.549327 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.549472 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.549638 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.549794 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.549938 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.550090 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.550239 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.550391 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.550545 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.550690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.550847 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.550998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.551148 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.551325 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.551496 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.551668 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.551820 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.551964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.552107 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.552260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.552412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.552564 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 15:17:47.552709 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.552851 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.553000 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.553153 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.553304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.553448 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.553609 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.553761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.554287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.554529 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.554680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.554824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.554967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.555118 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.555286 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.555449 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.555600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.555745 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.555898 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.555898 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.556189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.556189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.556467 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.556467 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.556754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.556911 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.557068 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.557212 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.557362 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.557512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.557662 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.557817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.557974 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.558118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.558267 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.558418 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.558561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.558711 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.558864 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.559008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.559160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.559385 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.559537 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.559694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.559855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.560009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.560160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.560310 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.560454 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.560610 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.560761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.560906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.561056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.561200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.561508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.561667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.561667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.561966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.562117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.562260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.562402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.562553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.562704 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.562847 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.562997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.563141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.563322 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.563474 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.563626 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.563786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.563938 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.564448 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.564611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.564756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.564756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.565033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.565205 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.565455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.565632 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.565780 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.565923 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.566072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.566231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.566383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.566383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.566672 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.566832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.566977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.567126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.567340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.567486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.567638 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.567781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.567924 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.568066 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.568232 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.568378 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.568520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.568669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.568819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.569516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.569778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.569946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.570095 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.570246 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.570391 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.570533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.570686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.570849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.571001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.571001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.571298 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.571443 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.571604 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.571756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.571908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.572058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.572208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.572365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.572511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.572671 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.572814 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.572956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.573108 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.573265 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.573409 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.573552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.573701 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.573845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.573995 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.574176 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.574677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.574831 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.574986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.575137 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.575326 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.575482 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.575628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.575771 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.575913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.576056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.576208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.576359 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.576510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.576663 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.576814 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.576967 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.577124 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.577267 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.577418 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.577568 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.577712 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.577863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.578014 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.578159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.578302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.578444 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.578594 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.578747 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.578904 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.579055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.579218 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.579366 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.579664 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.579808 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.579962 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.580112 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.580256 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.580399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.580598 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.580764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.580917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.581060 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.581210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.581360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.581516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.581701 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.581854 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.581999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.582141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.582291 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.582448 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.582600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.582783 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.582930 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.583081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.583272 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.583422 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.583565 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.583707 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.583904 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.584061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.585313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.585509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.585679 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.585866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.586081 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.586239 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.586394 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.586546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.586698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.586840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.586990 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.587141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.587324 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.587470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.587613 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.587763 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.587906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.588072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.588219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.588368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.588510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.588653 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.588795 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.588795 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.589088 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.589239 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.589384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.589533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.589683 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.589856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.590005 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.590162 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.590314 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.590457 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.590600 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.590756 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.590907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.591050 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.591860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.592039 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.592194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.592349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.592349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.592645 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.592787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.592938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.593092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.593237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.593379 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.593522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.593665 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.593814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.593966 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.594117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.594261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.594418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.594562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.594946 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.595113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.595296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.595617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.595768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.595768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.596469 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.596635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.596780 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.596924 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.597075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.597239 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.597392 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.597548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.597800 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.597960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.598103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.598247 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.598399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.598550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.598703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.598848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.598998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.599153 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.599351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.599506 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.599658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.599821 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.599966 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.600108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.600302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.600450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.600628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.600833 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.600981 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.601132 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.601293 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.601437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.601580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.601732 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.601885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.602029 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.602172 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.602321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.602471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.602628 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.602781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.602933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.603076 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.603076 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.603076 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.603532 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.603675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.603825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.603969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.604118 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.604270 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.604415 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.604563 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.604713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.605106 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.605269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.605439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.605672 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.605837 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.606076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.606076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.606369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.606527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.606697 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.606855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.606999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.607151 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.607341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.607505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.607655 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.607799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.607949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.608117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.608800 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.608966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.609119 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.609264 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.609415 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.609568 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.609741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.609896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.610065 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.610218 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.610368 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.610566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.610719 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.610869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.611025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.611210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.611378 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.611538 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.611688 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.611844 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.612001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.612162 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.612313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.612471 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.612628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.612778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.612926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.613081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.613230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.613230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.614314 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.614492 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.614655 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.614806 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.614995 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.615446 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.615446 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.615871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.616028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.616187 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.616374 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.617626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.617803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.617958 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.618109 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.618267 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.618429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.618601 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.618763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.618914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.619071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.619242 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.619413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.619575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.619741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.619902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.620051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.620199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.620434 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.620605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.620757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.620914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621688 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621996 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.621996 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.622296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.622446 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.622618 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.622769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.622919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.623077 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.623256 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.623412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.623569 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.623728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.623888 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.624049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.624200 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.624357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.624357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.624658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.624822 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.624982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.625132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.625553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.625726 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.625978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.626136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.626294 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.626453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.626604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.626824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.626976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.627142 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.627450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.627608 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.627608 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.627910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.628062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.628211 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.628360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.628510 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.628671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.628823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.628971 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.629134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.629291 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.629442 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.629601 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.629772 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.629922 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.630071 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.630228 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.630379 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.630543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.630701 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.630859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.631016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.631196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.631370 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.632110 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.632313 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.632465 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.632615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.632765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.632926 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.633084 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.633241 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.633400 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.633551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.633709 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.633880 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.634037 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.634195 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.634354 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.634512 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.635238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.635532 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.635854 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.636114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.636272 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.636437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.636607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.636758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.636918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.637067 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.637227 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.637377 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.637647 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.637813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.637972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.638131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.638281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.638432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.638602 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.638762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.638924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.639075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.639256 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.639420 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.639585 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.639585 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.639890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.640048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.640198 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.640363 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.640514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.640671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.640828 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.640990 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.641140 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.641302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.641453 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.641601 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.641751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.641916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.642073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.642236 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.642399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.642549 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.642705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.642857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.643017 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.643246 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.643405 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.643556 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.643718 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.643870 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.644035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.644186 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.644336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.644485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.644635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.644792 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.644953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.645114 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.645272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.645430 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.645675 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.645990 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.646234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.646398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.646558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.646716 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.646874 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.647049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.648047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.648047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.648365 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.648525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.648683 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.648843 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.648994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.649146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.649889 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.650052 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.650203 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.650364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.650523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.650682 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.650850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.651002 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.651153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.651153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.651153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.651639 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.651790 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.651941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.652089 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.652255 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.652413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.652572 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.652723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.652883 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.652883 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.653185 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.653337 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.653487 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.653637 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.653794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.653954 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.654105 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.654228 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.654336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.654920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.655018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.655117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.655278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.655402 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.655514 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.655649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.655851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.656137 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.656341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.656461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.656573 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.656690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.656816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.656936 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.657056 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.657166 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.657284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.657413 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.657539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.657665 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.658048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.658259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.658383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.658503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.658624 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.658743 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.658854 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.659416 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.659537 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.659649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.659853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.659969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660081 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660303 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660544 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660657 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660886 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.660997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.661220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.661338 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.661450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.661568 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.661680 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.661803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.662071 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.662188 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.662305 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.662416 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.662534 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.662694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.662887 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663375 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663615 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663727 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663838 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.663955 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664067 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664190 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664301 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664536 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664648 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664887 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.664998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665115 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665337 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665337 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.665678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.666549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.666667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.666777 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.666888 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667013 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667147 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667555 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.667963 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.668076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.668194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.668419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.668546 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.668546 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.668778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.668897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669119 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669119 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669466 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669585 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.669929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670530 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.670875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671050 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671188 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671449 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671569 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671680 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671790 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.671898 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672228 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672355 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672474 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672586 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672813 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.672931 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673055 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673167 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673615 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.673955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674295 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674407 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674517 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674626 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674735 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.674844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675067 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675232 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675715 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675826 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.675952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.676154 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.676428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.676428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.676654 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.676772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.676883 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677112 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677301 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677422 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677832 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.677960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.678079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.678189 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.678345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.678653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.678824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.678956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679070 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679199 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679330 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679555 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679809 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.679923 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680160 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680513 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680741 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680852 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.680973 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681327 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681556 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681681 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681792 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.681903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.682021 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.682139 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.682352 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.682970 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683363 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683477 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683597 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683720 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683831 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.683941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684058 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684180 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684536 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684886 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.684998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.685108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.685219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.685219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.685433 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.685629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.685751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.685870 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.686008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.686782 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.686906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687331 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687572 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.687928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.688040 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.688165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.688285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.688409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.688528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.688669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.688875 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689000 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689000 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689573 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.689946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690168 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690395 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690868 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.690980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691090 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691356 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691476 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691814 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.691939 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692490 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692744 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692863 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.692976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.693115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.693241 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.693365 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.693477 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.693595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.693707 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.693817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.694440 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.694574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.694688 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.694805 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.694924 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.695036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.695154 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.695302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.695417 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.698407 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.698538 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.698655 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.698784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.698899 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.699011 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.699129 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.699390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.699519 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.699647 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.699781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.699899 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700362 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700711 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.700941 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701066 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701183 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701295 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701414 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701526 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701650 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.701996 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.702114 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.702231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.702351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.702488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.702681 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.702798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.702908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703018 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703137 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703395 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703766 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.703890 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704003 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704120 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704120 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704120 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704430 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704621 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704743 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704863 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.704981 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705347 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705458 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.705927 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706040 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706319 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706660 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.706890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707112 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707370 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707613 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707736 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.707867 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.708194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.708316 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.708978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.709108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.709221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.709361 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.709724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.710427 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.710569 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.710683 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.710804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.710917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.711027 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.711144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.711588 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.711732 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.712373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.712522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.712678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.712900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.713037 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.713179 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.713318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.713448 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.713586 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.713727 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.713865 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714013 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714151 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714289 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714576 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.714969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.715111 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.715275 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.715415 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.715553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.715683 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.715820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.715957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.716096 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.716234 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.716365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.716494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.716623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.716761 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.716904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.717034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.717164 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.717294 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.717857 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.717857 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.718378 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.718524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.718524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.718780 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.718918 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.719058 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.719213 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.719213 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.719475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.719635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.719866 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720268 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720545 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720678 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720678 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.720937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721066 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721589 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721718 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.721986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.722116 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.722260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.722392 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.722522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.722522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.722994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723085 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723217 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723477 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723746 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723746 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.723909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724624 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724884 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.724978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.725063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.725169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.725268 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.725410 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.725595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.725765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.725917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.726091 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.726243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.726386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.726624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.726729 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.726944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.727036 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.727278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.727427 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.727593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.727723 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.727909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.728013 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.728224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.728340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.728535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.728647 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.728844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.728951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.729152 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.729307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.729461 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.729627 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.729767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.729949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.730059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.730262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.730369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.730601 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.730737 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.730953 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.731047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.731281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.731378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.731593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.731695 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.731899 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.732002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.732203 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.732306 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.732512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.732605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.732819 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.732914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.733124 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.733216 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.733440 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.733584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.733776 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.733870 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.734101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.734251 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.734417 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.734645 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.734740 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.734983 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.735083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.735336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.735432 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.735669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.735771 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.735994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.736110 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.736310 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.736411 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.736620 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.736721 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.736953 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.737046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.737264 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.737370 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.737577 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.737679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.737889 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.737983 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.738200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.738322 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.738558 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.738674 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.738817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.738912 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.739133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.739295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.739487 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.739606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.739794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.739900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.740106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.740211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.740421 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.740526 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.740735 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.740900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.741070 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.741163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.741380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.741481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.741695 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.741794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.742039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.742134 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.742364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.742458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.742684 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.742785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.743004 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.743104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.743351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.743459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.743669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.743770 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.743979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.744069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.744293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.744383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.744608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.744715 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.744916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.745008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.745244 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.745345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.745559 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.745688 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.745890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.745991 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.746207 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.746411 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.746552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.746726 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.746882 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.747049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.747337 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.747438 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.747543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.747697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.747835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.748078 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 15:17:47.748191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.749935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.750268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.750604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.750927 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.751290 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.751639 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.752891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.753238 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.753562 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.753886 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.754198 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.754519 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.754850 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.755192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.755618 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.755936 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.756386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.757156 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.757553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.757863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.758176 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.758492 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.758813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.759108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.759455 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.759749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.760055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.760365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.760680 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.760985 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.761293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.761599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.761907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.762212 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.762545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.762879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.763215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.763544 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.763860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.764185 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.764499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.764823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.765146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.765468 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.765787 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.766122 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.766437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.766750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.767063 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.767420 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.767736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.768049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.768379 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.768707 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.769018 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.769342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.769664 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.769986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.770307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.770622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.770953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.771291 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.771604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.771923 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.772783 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.773092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.773410 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.773728 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.774056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.774383 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.774696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.775022 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.775376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.775731 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.776044 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.776388 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.776715 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.777032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.777345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.777651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 15:17:47.777896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 15:17:47.809934 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Registered counter for database nova_api Jun 24 15:17:47.830457 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:47.837653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:47.840554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Registered counter for database nova_api Jun 24 15:17:47.860171 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:47.867600 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:47.893706 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.context [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780(cell1) {{(pid=118274) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 15:17:47.897855 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:17:47.903428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:17:47.903428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:17:47.903428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:17:47.904209 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Registered counter for database nova_cell0 Jun 24 15:17:47.908437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Registered counter for database nova_cell1 Jun 24 15:17:47.916035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:47.917323 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:47.924696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:47.924930 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.context [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780(cell1) {{(pid=118273) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 15:17:47.925064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:47.929719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:17:47.931406 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:17:47.932218 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:17:47.934203 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:17:47.936233 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Registered counter for database nova_cell0 Jun 24 15:17:47.940268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Registered counter for database nova_cell1 Jun 24 15:17:47.951877 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:47.953054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:47.959783 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:47.961953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:48.074765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO dbcounter [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Registered counter for database nova_cell0 Jun 24 15:17:48.081235 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_db.sqlalchemy.engines [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:48.087322 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writer thread running {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:48.111330 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO dbcounter [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Registered counter for database nova_cell0 Jun 24 15:17:48.118403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_db.sqlalchemy.engines [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 15:17:48.122825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writer thread running {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 15:17:48.398434 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:17:48.405705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:17:48.444751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:17:48.452068 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:17:48.745661 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:17:48.751532 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: WARNING keystonemiddleware.auth_token [None req-5fe9cfe6-8873-44f9-bc98-6a0efe0d210b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:17:48.757607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab17b3e9c0 pid: 118274 (default app) Jun 24 15:17:48.792169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 15:17:48.798201 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: WARNING keystonemiddleware.auth_token [None req-6b5fc35e-094c-4b1d-8bce-d501079241d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 15:17:48.804180 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab17b3e9c0 pid: 118273 (default app) Jun 24 15:18:30.740306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:30.742531 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:30.743278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:30.745839 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:32.792218 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-24ec9773-c21b-423e-810d-569a5ab43dd4 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Action: 'create', calling method: .version_select at 0x7f18b406f700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1699295972"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:35.624483 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-318e9c41-8466-4967-9136-a331313a6cf3 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b411b280>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:35.664524 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-24ec9773-c21b-423e-810d-569a5ab43dd4 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.941360 Jun 24 15:18:35.673165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1154 bytes} [Fri Jun 24 15:18:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4946 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 15:18:35.693651 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6fd53641-e383-4a37-9b3b-1fdb4e1fb183 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3f35550>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:35.729141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:35.732531 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:35.733775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:35.734768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:35.869654 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6fd53641-e383-4a37-9b3b-1fdb4e1fb183 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6" status: 200 len: 345 microversion: 2.1 time: 0.194445 Jun 24 15:18:35.870669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 2/2] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:35 2022] GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:36.242656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-318e9c41-8466-4967-9136-a331313a6cf3 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ba4a2a80-fe35-4541-a4fe-ee1355b4a167" status: 200 len: 351 microversion: 2.1 time: 1.273440 Jun 24 15:18:36.249121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 1/3] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:34 2022] GET /compute/v2.1/os-volumes/ba4a2a80-fe35-4541-a4fe-ee1355b4a167 => generated 351 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:36.882476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-195d7434-7752-4c56-a42f-29b9c24686a6 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3f358b0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:37.170268 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-195d7434-7752-4c56-a42f-29b9c24686a6 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6" status: 200 len: 346 microversion: 2.1 time: 0.292016 Jun 24 15:18:37.171105 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 3/4] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:36 2022] GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 => generated 346 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:37.183041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5e8a155b-4e7f-4d56-bdd8-6cb2c47375f4 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Action: 'create', calling method: .version_select at 0x7f18b3f71790>, body: {"snapshot": {"volume_id": "1b98badb-90f5-480c-b484-85bb57b564b6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-64871687"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:38.117979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5e8a155b-4e7f-4d56-bdd8-6cb2c47375f4 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.935355 Jun 24 15:18:38.124986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 2/5] 10.222.0.67 () {60 vars in 1161 bytes} [Fri Jun 24 15:18:37 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:38.132192 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-66495587-83c9-46f5-9216-6d0911d7f613 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3f35ca0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:38.410580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-66495587-83c9-46f5-9216-6d0911d7f613 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 285 microversion: 2.1 time: 0.283806 Jun 24 15:18:38.412887 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 4/6] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:38 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:38.423716 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ead0afa1-12a6-420d-a5b6-c54b24008b1c tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3f710d0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:39.386492 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ead0afa1-12a6-420d-a5b6-c54b24008b1c tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.967417 Jun 24 15:18:39.387380 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 3/7] 10.222.0.67 () {58 vars in 1139 bytes} [Fri Jun 24 15:18:38 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:39.397866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5c7ae58d-d68d-42df-aa46-36d6f4a7b338 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3f71f70>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:39.472314 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-810589383", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "networks": [{"uuid": "9fcf8abc-a8a5-4725-9758-d53e9c47196e"}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:39.573696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5c7ae58d-d68d-42df-aa46-36d6f4a7b338 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 285 microversion: 2.1 time: 0.179909 Jun 24 15:18:39.574435 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:39 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:18:39.587509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4807da5f-0357-4cbe-a0d4-0a1bc9649eb2 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b3f71790>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:39.717774 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] validate_networks() for [('9fcf8abc-a8a5-4725-9758-d53e9c47196e', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:18:39.788045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4807da5f-0357-4cbe-a0d4-0a1bc9649eb2 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/3c70a5f8-886d-4ce2-bb08-e0ed879445f1" status: 200 len: 350 microversion: 2.1 time: 0.204707 Jun 24 15:18:39.790574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 5/9] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:39 2022] GET /compute/v2.1/os-volumes/3c70a5f8-886d-4ce2-bb08-e0ed879445f1 => generated 350 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:40.587819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fe4b7c4b-39be-4caf-aec5-0f4e54cedb16 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3f464c0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:40.715057 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fe4b7c4b-39be-4caf-aec5-0f4e54cedb16 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 285 microversion: 2.1 time: 0.133678 Jun 24 15:18:40.720013 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 6/10] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:40 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:18:41.002250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:18:41.002684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:18:41.002981 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:18:41.004182 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:18:41.005868 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:18:41.038885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:41.039372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:41.044285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:41.048341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:41.152988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Getting quotas for project d6e6bc2109c44c37a0ed635b021bba7e. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:18:41.179593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Getting quotas for user 78195ff60f0242ada974a8e08d1f2754 and project d6e6bc2109c44c37a0ed635b021bba7e. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:18:41.205428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:18:41.214974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:18:41.414494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-80acf5bf-79b1-435c-aee1-c525e3c0ee24 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.076642 Jun 24 15:18:41.416754 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 5/11] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:18:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 15:18:41.430427 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-896cb9ae-973b-4bea-bbee-d752d4f871a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:41.432507 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-896cb9ae-973b-4bea-bbee-d752d4f871a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:41.680364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-896cb9ae-973b-4bea-bbee-d752d4f871a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:41.715258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-896cb9ae-973b-4bea-bbee-d752d4f871a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1214 microversion: 2.1 time: 0.292417 Jun 24 15:18:41.718635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 7/12] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:41 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:41.728245 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2551e6b1-588f-4154-8f18-135a4fcc9e32 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b35da160>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:41.800036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2551e6b1-588f-4154-8f18-135a4fcc9e32 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 285 microversion: 2.1 time: 0.076399 Jun 24 15:18:41.800616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 6/13] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:41 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 285 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:42.734691 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9de58d45-5d69-4302-8419-235745c4706b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:42.735378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9de58d45-5d69-4302-8419-235745c4706b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:42.814161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d74c3126-af28-45f4-bce7-e9b915007b32 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b35da8b0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:42.893883 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d74c3126-af28-45f4-bce7-e9b915007b32 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 286 microversion: 2.1 time: 0.085225 Jun 24 15:18:42.901001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 7/14] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:42 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:18:42.902097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9de58d45-5d69-4302-8419-235745c4706b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:42.906054 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c24e6de3-6351-4d14-b446-f13553ac1990 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3e3df70>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:42.917553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9de58d45-5d69-4302-8419-235745c4706b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1214 microversion: 2.1 time: 0.186833 Jun 24 15:18:42.932323 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 8/15] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:42 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:43.053777 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8dc3c5dc-fd07-4d1b-9982-ee1c6ee9ed3f tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b3f018b0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:43.159497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8dc3c5dc-fd07-4d1b-9982-ee1c6ee9ed3f tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d9e55b2c-8464-4145-a8a1-8d91276a4e45" status: 200 len: 351 microversion: 2.1 time: 0.113977 Jun 24 15:18:43.166678 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 9/16] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:43 2022] GET /compute/v2.1/os-volumes/d9e55b2c-8464-4145-a8a1-8d91276a4e45 => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:43.166845 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c24e6de3-6351-4d14-b446-f13553ac1990 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 202 len: 0 microversion: 2.1 time: 0.258779 Jun 24 15:18:43.168141 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 8/17] 10.222.0.67 () {58 vars in 1253 bytes} [Fri Jun 24 15:18:42 2022] DELETE /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:18:43.172262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e6728c5-bd59-40d7-a96d-e2274d9d69f2 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3f01dc0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:43.173132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e9419c5f-21ee-49d6-9c96-2c05963df439 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b35da820>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:43.221317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4e6728c5-bd59-40d7-a96d-e2274d9d69f2 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 285 microversion: 2.1 time: 0.053072 Jun 24 15:18:43.221952 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 10/18] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:43 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 285 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:18:43.382685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e9419c5f-21ee-49d6-9c96-2c05963df439 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213360 Jun 24 15:18:43.391081 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 9/19] 10.222.0.67 () {58 vars in 1133 bytes} [Fri Jun 24 15:18:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:43.400960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3b526b48-bcf7-464e-8ef5-ba19738120c8 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b3f01ca0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:43.668126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3b526b48-bcf7-464e-8ef5-ba19738120c8 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.275803 Jun 24 15:18:43.671093 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 11/20] 10.222.0.67 () {58 vars in 1148 bytes} [Fri Jun 24 15:18:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:43.681668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-18319bba-8106-4546-af98-c0180a13dab5 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b35e80d0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:43.941223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9b6ca9ea-b868-4ff3-b2cf-f7bf54283d3e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:43.941223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9b6ca9ea-b868-4ff3-b2cf-f7bf54283d3e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:43.952723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-18319bba-8106-4546-af98-c0180a13dab5 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.274727 Jun 24 15:18:43.960872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 10/21] 10.222.0.67 () {58 vars in 1133 bytes} [Fri Jun 24 15:18:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:43.971097 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-576f4f57-011d-4ff3-a4f7-8e7b49e300fc tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b35dae50>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:44.258360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-576f4f57-011d-4ff3-a4f7-8e7b49e300fc tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.291327 Jun 24 15:18:44.266989 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 11/22] 10.222.0.67 () {58 vars in 1166 bytes} [Fri Jun 24 15:18:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:44.383662 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9b6ca9ea-b868-4ff3-b2cf-f7bf54283d3e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:44.396268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9b6ca9ea-b868-4ff3-b2cf-f7bf54283d3e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1214 microversion: 2.1 time: 0.458712 Jun 24 15:18:44.407417 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 12/23] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:43 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1214 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:44.585821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1857507423", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:44.687001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-db95ccc2-040f-4e61-b60e-8758659e7cb3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'create', calling method: .version_select at 0x7f18b3efb9d0>, body: {"keypair": {"name": "tempest-keypair-166697729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ6GrSowKAwKD1fnJe8MxrcjR/mHFBWxA7PBNUDE9pUAEWa/M8aCEVeLqioxEtUxHVKHcrtBZiC9ADUoK/Toyg0Or9o7mWoUQPDOxAQpYUVKNlSPgm9DD4DDSkY7ubtZg=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:44.732105 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] validate_networks() for [('af13b512-ccae-46a6-b2e4-3851b74c876d', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:18:44.769318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-db95ccc2-040f-4e61-b60e-8758659e7cb3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:18:44.777621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-db95ccc2-040f-4e61-b60e-8758659e7cb3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for user 206ca9f278fc47e4a9a4f720083e91f3 and project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:18:44.962921 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-db95ccc2-040f-4e61-b60e-8758659e7cb3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.560352 Jun 24 15:18:44.965000 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 13/24] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Jun 24 15:18:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 563 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 15:18:44.970027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a292e5d6-d173-4463-99c3-a2d23d0ba3ff tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b3e8b670>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:45.050900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a292e5d6-d173-4463-99c3-a2d23d0ba3ff tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 285 microversion: 2.1 time: 0.082364 Jun 24 15:18:45.050900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 14/25] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:44 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:45.053968 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-93bb4bb5-8d99-40f7-a4e5-cd03dc1ad943 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b3e68af0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:45.250733 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-93bb4bb5-8d99-40f7-a4e5-cd03dc1ad943 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.198938 Jun 24 15:18:45.250733 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 15/26] 10.222.0.67 () {58 vars in 1169 bytes} [Fri Jun 24 15:18:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:45.262524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e2dc0591-4fa2-407d-9d98-5495f4d7e571 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b3629040>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:45.432902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:18:45.433385 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:18:45.434766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:18:45.434766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:18:45.435163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:18:45.468292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:45.471342 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:45.473571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:45.478485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:45.542354 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:18:45.547782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e2dc0591-4fa2-407d-9d98-5495f4d7e571 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.288929 Jun 24 15:18:45.548360 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 16/27] 10.222.0.67 () {58 vars in 1154 bytes} [Fri Jun 24 15:18:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:18:45.556535 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:45.557174 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:45.568731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for user b67761f9b13340a090efc1cb07714912 and project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:18:45.568866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:45.568866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:45.568866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:45.569104 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:45.621632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:18:45.623894 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:18:45.762523 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:45.778348 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1e2a3ba1-f2ee-4eeb-869c-a56d80cc149d tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1218 microversion: 2.1 time: 0.228854 Jun 24 15:18:45.788774 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 17/28] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:45 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:45.809146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-34a58b25-8876-4db9-a00c-d23bd9e66617 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b358fb80>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:45.821366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-486a8b55-3ccb-45be-baed-1ff9a2a04953 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.556485 Jun 24 15:18:45.823708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 12/29] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:18:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:18:45.839895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1730eeba-c770-4934-a748-cd309a2392b9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:45.841240 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1730eeba-c770-4934-a748-cd309a2392b9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:45.962841 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1730eeba-c770-4934-a748-cd309a2392b9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:45.990916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1730eeba-c770-4934-a748-cd309a2392b9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1222 microversion: 2.1 time: 0.161716 Jun 24 15:18:45.994489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 13/30] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:45 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:46.063226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-290f54f0-0c6a-444f-b111-0cc4c6a03bf1 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b35da0d0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:46.121329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-34a58b25-8876-4db9-a00c-d23bd9e66617 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.331149 Jun 24 15:18:46.123480 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 18/31] 10.222.0.67 () {58 vars in 1187 bytes} [Fri Jun 24 15:18:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:46.138861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d1a3e1d5-8912-4359-bbc0-17db5d7e9641 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] Calling method '.version_select at 0x7f18b359b940>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:46.214221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-290f54f0-0c6a-444f-b111-0cc4c6a03bf1 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 200 len: 285 microversion: 2.1 time: 0.157186 Jun 24 15:18:46.214923 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 14/32] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:46 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:46.307027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d1a3e1d5-8912-4359-bbc0-17db5d7e9641 tempest-VolumesTestJSON-2099745183 tempest-VolumesTestJSON-2099745183-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.174993 Jun 24 15:18:46.307781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 19/33] 10.222.0.67 () {58 vars in 1154 bytes} [Fri Jun 24 15:18:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:46.308424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1158400012", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:46.437802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] validate_networks() for [('af13b512-ccae-46a6-b2e4-3851b74c876d', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:18:46.797933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:46.798555 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:46.807067 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:46.807552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:46.808369 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:46.808869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:47.053774 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:47.070659 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a7c354e0-9a67-4ff0-b241-7c119ffb0aae tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1210 microversion: 2.1 time: 0.270656 Jun 24 15:18:47.071586 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 20/34] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:46 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1210 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:18:47.226800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d55f3992-1362-43a2-b3e3-42663ec29fd6 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b35bcaf0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:47.319684 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-d55f3992-1362-43a2-b3e3-42663ec29fd6 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] HTTP exception thrown: Snapshot 6b060331-3d86-4e80-9709-a28ab738789e could not be found. Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d55f3992-1362-43a2-b3e3-42663ec29fd6 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Request method failure captured: Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e HTTP/1.1 Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXG_Lydo4O-a-dn_9xoicJyd_oXHXIGTBGvL3z1nHidztio9j7pu-G_MniB2HJjyUXnJ4SNIv834QYsm__BLA0mzXzQGpjrxGDf9Fh4YBIQiPvosXzVa-abQ5ignNrEyDTjkAyZo_pIF9rEGjUMl6xrg11u6iIryaqsikBqSa6Ldxs Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:18:47.323977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3326c29b85f643c28253c9ce948bda8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: a3cd1f48d64f47868ed582f79a7906f7 Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Snapshot 6b060331-3d86-4e80-9709-a28ab738789e could not be found. Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '6b060331-3d86-4e80-9709-a28ab738789e'} Jun 24 15:18:47.325234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6b060331-3d86-4e80-9709-a28ab738789e could not be found. (HTTP 404) (Request-ID: req-61a9101f-d2e2-4c25-b469-5083f1ab6ca4) Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:47.325904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:18:47.329023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6b060331-3d86-4e80-9709-a28ab738789e could not be found. Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 15:18:47.330045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6b060331-3d86-4e80-9709-a28ab738789e could not be found. Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6b060331-3d86-4e80-9709-a28ab738789e could not be found. Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d55f3992-1362-43a2-b3e3-42663ec29fd6 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Returning 404 to user: Snapshot 6b060331-3d86-4e80-9709-a28ab738789e could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d55f3992-1362-43a2-b3e3-42663ec29fd6 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e" status: 404 len: 111 microversion: 2.1 time: 0.103520 Jun 24 15:18:47.331026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 21/35] 10.222.0.67 () {58 vars in 1250 bytes} [Fri Jun 24 15:18:47 2022] GET /compute/v2.1/os-snapshots/6b060331-3d86-4e80-9709-a28ab738789e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:18:47.360982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b7bb3cad-63f8-4484-bec7-76059dcf1da5 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b35bcca0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:47.658805 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:18:47.659327 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:18:47.659775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:18:47.663300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:18:47.663300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:18:47.681208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:47.681671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:47.685437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:47.685898 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:47.729730 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:18:47.732863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b7bb3cad-63f8-4484-bec7-76059dcf1da5 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6" status: 202 len: 0 microversion: 2.1 time: 0.402175 Jun 24 15:18:47.733823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 22/36] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:18:47 2022] DELETE /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:18:47.742206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for user b67761f9b13340a090efc1cb07714912 and project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:18:47.742526 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76bc2a61-f404-4d51-9b88-e1b3afe366c3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b35a5550>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:47.772471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:18:47.777429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:18:47.843459 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76bc2a61-f404-4d51-9b88-e1b3afe366c3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6" status: 200 len: 345 microversion: 2.1 time: 0.105510 Jun 24 15:18:47.844112 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 23/37] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:47 2022] GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:18:48.011599 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-13a2fbf5-ccb5-4f1d-a79c-783dbbef6430 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.708179 Jun 24 15:18:48.012269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 15/38] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:18:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:18:48.023050 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6335fb51-1884-482d-ba7a-7771d6b39279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:48.023729 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6335fb51-1884-482d-ba7a-7771d6b39279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:48.105726 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:48.105726 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:48.114461 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:48.115245 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:48.116069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:48.116520 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:48.331682 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6335fb51-1884-482d-ba7a-7771d6b39279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:48.339921 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6335fb51-1884-482d-ba7a-7771d6b39279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1222 microversion: 2.1 time: 0.321494 Jun 24 15:18:48.342566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 24/39] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:48 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1222 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:48.856489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aceef28f-403d-48bd-a59f-e7d7b47006f9 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b359bd30>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:48.898167 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:48.935099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-367f1e64-7cf3-4422-b2e3-3423193e534e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1274 microversion: 2.1 time: 0.846546 Jun 24 15:18:48.947366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 16/40] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:48 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1274 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:48.960350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-aceef28f-403d-48bd-a59f-e7d7b47006f9 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] HTTP exception thrown: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aceef28f-403d-48bd-a59f-e7d7b47006f9 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Request method failure captured: Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 HTTP/1.1 Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXG_Lydo4O-a-dn_9xoicJyd_oXHXIGTBGvL3z1nHidztio9j7pu-G_MniB2HJjyUXnJ4SNIv834QYsm__BLA0mzXzQGpjrxGDf9Fh4YBIQiPvosXzVa-abQ5ignNrEyDTjkAyZo_pIF9rEGjUMl6xrg11u6iIryaqsikBqSa6Ldxs Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:18:48.963144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3326c29b85f643c28253c9ce948bda8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: a3cd1f48d64f47868ed582f79a7906f7 Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '1b98badb-90f5-480c-b484-85bb57b564b6'} Jun 24 15:18:48.964245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. (HTTP 404) (Request-ID: req-773a425c-4b00-4a49-8d53-3e60caefb92d) Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:48.964892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:18:48.965892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 15:18:48.969658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aceef28f-403d-48bd-a59f-e7d7b47006f9 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Returning 404 to user: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:18:48.972032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aceef28f-403d-48bd-a59f-e7d7b47006f9 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6" status: 404 len: 109 microversion: 2.1 time: 0.112494 Jun 24 15:18:48.978960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 25/41] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:48 2022] GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:18:48.984077 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-571e6c9f-bc44-42fb-bda9-5a79c4759fc3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b2d2bee0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:49.118924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-571e6c9f-bc44-42fb-bda9-5a79c4759fc3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] HTTP exception thrown: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-571e6c9f-bc44-42fb-bda9-5a79c4759fc3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Request method failure captured: Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 HTTP/1.1 Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXG_Lydo4O-a-dn_9xoicJyd_oXHXIGTBGvL3z1nHidztio9j7pu-G_MniB2HJjyUXnJ4SNIv834QYsm__BLA0mzXzQGpjrxGDf9Fh4YBIQiPvosXzVa-abQ5ignNrEyDTjkAyZo_pIF9rEGjUMl6xrg11u6iIryaqsikBqSa6Ldxs Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:18:49.123906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3326c29b85f643c28253c9ce948bda8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: a3cd1f48d64f47868ed582f79a7906f7 Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '1b98badb-90f5-480c-b484-85bb57b564b6'} Jun 24 15:18:49.125285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. (HTTP 404) (Request-ID: req-d7ec4e83-d1a4-421b-a000-b1300c5c4297) Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:49.126011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 15:18:49.127122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 15:18:49.128475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.130136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.137618 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-571e6c9f-bc44-42fb-bda9-5a79c4759fc3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Returning 404 to user: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:18:49.137618 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-571e6c9f-bc44-42fb-bda9-5a79c4759fc3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6" status: 404 len: 109 microversion: 2.1 time: 0.157891 Jun 24 15:18:49.138608 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 17/42] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:18:48 2022] DELETE /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:18:49.147058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be711d01-a5d4-4afd-bf7d-aa7dd9abccb3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Calling method '.version_select at 0x7f18b358f940>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:49.259462 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-be711d01-a5d4-4afd-bf7d-aa7dd9abccb3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] HTTP exception thrown: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be711d01-a5d4-4afd-bf7d-aa7dd9abccb3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Request method failure captured: Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 HTTP/1.1 Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXG_Lydo4O-a-dn_9xoicJyd_oXHXIGTBGvL3z1nHidztio9j7pu-G_MniB2HJjyUXnJ4SNIv834QYsm__BLA0mzXzQGpjrxGDf9Fh4YBIQiPvosXzVa-abQ5ignNrEyDTjkAyZo_pIF9rEGjUMl6xrg11u6iIryaqsikBqSa6Ldxs Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:18:49.265329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3326c29b85f643c28253c9ce948bda8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3326c29b85f643c28253c9ce948bda8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 3326c29b85f643c28253c9ce948bda8a Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-874776606 Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: a3cd1f48d64f47868ed582f79a7906f7 Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotsTestJSON-874776606-project Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '1b98badb-90f5-480c-b484-85bb57b564b6'} Jun 24 15:18:49.266578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. (HTTP 404) (Request-ID: req-52ee5b35-b759-4d18-bfd5-47d255fed64a) Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:49.267350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:18:49.268539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 15:18:49.269641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. Jun 24 15:18:49.271624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:18:49.274218 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be711d01-a5d4-4afd-bf7d-aa7dd9abccb3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] Returning 404 to user: Volume 1b98badb-90f5-480c-b484-85bb57b564b6 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:18:49.275956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be711d01-a5d4-4afd-bf7d-aa7dd9abccb3 tempest-VolumesSnapshotsTestJSON-874776606 tempest-VolumesSnapshotsTestJSON-874776606-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6" status: 404 len: 109 microversion: 2.1 time: 0.133135 Jun 24 15:18:49.276881 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 26/43] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:18:49 2022] GET /compute/v2.1/os-volumes/1b98badb-90f5-480c-b484-85bb57b564b6 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:18:49.358092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-133ec8c3-c14c-4db2-a71a-396acaf74782 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:49.359671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-133ec8c3-c14c-4db2-a71a-396acaf74782 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:49.471650 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-133ec8c3-c14c-4db2-a71a-396acaf74782 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:49.481876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-133ec8c3-c14c-4db2-a71a-396acaf74782 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1222 microversion: 2.1 time: 0.129220 Jun 24 15:18:49.484080 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 18/44] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:49 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:49.955529 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:49.956148 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:49.980001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:49.980475 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:49.981287 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:49.981798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:50.194020 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:50.204609 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-383a4443-4bee-4e79-8822-01702b733a45 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1272 microversion: 2.1 time: 0.251881 Jun 24 15:18:50.207398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 27/45] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:49 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:50.374867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-946031175", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d1ef1dd-ee8a-4e52-9261-de77d4e705e2"}], "security_groups": [{"name": "tempest-securitygroup--517264912"}], "key_name": "tempest-keypair-166697729", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:50.506824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:50.510159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:50.530651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:50.534679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:50.547883 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:50.552221 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:50.950357 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:50.978958 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9f11aee6-fc36-40e8-bbc2-6e46a845ec50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1218 microversion: 2.1 time: 0.470923 Jun 24 15:18:50.979676 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 28/46] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:50 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1218 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:51.222519 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:51.223959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:51.248518 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:51.249344 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:51.251052 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:51.256033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:51.420019 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] validate_networks() for [('6d1ef1dd-ee8a-4e52-9261-de77d4e705e2', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:18:51.455208 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:51.482078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c36abaa9-66ef-4f42-b374-313090ee5d71 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1272 microversion: 2.1 time: 0.263664 Jun 24 15:18:51.499535 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 29/47] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:51 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:52.026981 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:52.028767 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:52.056496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:52.056496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:52.056496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:52.056496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:52.654910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:52.669822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1730c449-0e4c-4fb5-a89a-25440c90af55 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1274 microversion: 2.1 time: 0.659760 Jun 24 15:18:52.677979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 30/48] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:52 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1274 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:52.691461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:52.701354 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:52.720827 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:52.721585 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:52.729750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:52.730443 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:53.308562 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:53.326703 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-57f068fd-09b3-4770-a0b3-7a8ef9b49b55 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.647408 Jun 24 15:18:53.330813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 31/49] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:52 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:53.396249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:18:53.397288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:18:53.397807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:18:53.398247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:18:53.398666 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:18:53.421951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:53.422786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:53.424366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:53.424975 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:53.486590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:18:53.516861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for user 206ca9f278fc47e4a9a4f720083e91f3 and project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:18:53.552817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:18:53.555592 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:18:53.694125 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:53.694751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:53.708046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:53.708545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:53.712091 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:53.715970 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:53.744982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2568f0ab-c64f-4b3f-8029-88fd61e01b79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.374737 Jun 24 15:18:53.747976 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 19/50] 10.222.0.67 () {62 vars in 1187 bytes} [Fri Jun 24 15:18:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 3378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 15:18:53.776827 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-31942e9d-c215-4f7d-8f76-64db71320ba3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:53.778246 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-31942e9d-c215-4f7d-8f76-64db71320ba3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:53.916589 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31942e9d-c215-4f7d-8f76-64db71320ba3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:53.932083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31942e9d-c215-4f7d-8f76-64db71320ba3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:53.933597 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-31942e9d-c215-4f7d-8f76-64db71320ba3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:53.934709 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-31942e9d-c215-4f7d-8f76-64db71320ba3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1280 microversion: 2.20 time: 0.180066 Jun 24 15:18:53.953343 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 20/51] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:18:53 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:18:54.018708 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:54.043566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a73cde11-4037-48a0-bbe8-b3a0eb392d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1280 microversion: 2.1 time: 0.348754 Jun 24 15:18:54.044899 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 32/52] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:53 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1280 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:18:54.344930 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:54.352392 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:54.363844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:54.367254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:54.369996 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:54.394087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:54.826977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:54.838251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6f44430d-09e7-4d75-ab63-3ecc85626e0c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.497440 Jun 24 15:18:54.838964 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 21/53] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:54 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:54.962949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2ae1cd5f-04ec-4c00-a8f0-2186a2a96fa8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:54.964252 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ae1cd5f-04ec-4c00-a8f0-2186a2a96fa8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:55.064658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:55.065716 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:55.075647 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:55.076776 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:55.078252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:55.080208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:55.144529 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ae1cd5f-04ec-4c00-a8f0-2186a2a96fa8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:55.182014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ae1cd5f-04ec-4c00-a8f0-2186a2a96fa8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:55.194382 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ae1cd5f-04ec-4c00-a8f0-2186a2a96fa8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:55.198639 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2ae1cd5f-04ec-4c00-a8f0-2186a2a96fa8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1280 microversion: 2.20 time: 0.239970 Jun 24 15:18:55.208774 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 33/54] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:18:54 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:18:55.391583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:55.411163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3a45c8ae-9f84-400e-b011-71ad280ac6f5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1280 microversion: 2.1 time: 0.341874 Jun 24 15:18:55.416505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 22/55] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:55 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:55.856694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:55.857403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:55.872130 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:55.872130 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:55.874966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:55.878612 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:56.174296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:56.188361 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-da5d0a4e-0fb2-495a-82c2-ef7c742d440b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.336778 Jun 24 15:18:56.190830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 34/56] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:55 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:56.227254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:56.227254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:56.240824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:56.240824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:56.249380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:56.250146 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:56.435464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:56.436087 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:56.475857 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:56.476338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:56.477695 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:56.478327 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:57.327820 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:57.351393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:57.361013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:57.368130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a46b8631-ceb7-4d4b-b579-308c9e947121 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1284 microversion: 2.20 time: 1.146022 Jun 24 15:18:57.371225 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 23/57] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:18:56 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1284 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:18:57.391574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:57.394502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:57.426977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:57.427963 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:57.428998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:57.429647 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:57.673287 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:57.684800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-78354f5e-3ad1-468f-8ddf-ff62cc577f43 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 1.256642 Jun 24 15:18:57.685384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 35/58] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:56 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:58.082621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-cfe73a9d-b579-4962-9af9-7d5a7a46e479 req-aa500347-dbfe-405e-be99-0d3a858c33d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cb33d2-4d1f-4910-82a0-2ace0cc1144b", "tag": "471abd13-dcca-4d97-83ff-7d113a0b2e5b"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:18:58.121224 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-cfe73a9d-b579-4962-9af9-7d5a7a46e479 req-aa500347-dbfe-405e-be99-0d3a858c33d2 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:58.123944 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-cfe73a9d-b579-4962-9af9-7d5a7a46e479 req-aa500347-dbfe-405e-be99-0d3a858c33d2 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:58.180286 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:58.189800 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9286e24-03ab-44cf-a8b1-422e65637470 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.816781 Jun 24 15:18:58.198210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 24/59] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:57 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:58.208580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-cfe73a9d-b579-4962-9af9-7d5a7a46e479 req-aa500347-dbfe-405e-be99-0d3a858c33d2 service nova] Creating event network-changed:471abd13-dcca-4d97-83ff-7d113a0b2e5b for instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b on hv-cinder-83538 Jun 24 15:18:58.209129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-cfe73a9d-b579-4962-9af9-7d5a7a46e479 req-aa500347-dbfe-405e-be99-0d3a858c33d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118273) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 15:18:58.221462 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e390f51-e65c-441b-9ee3-52eb649762e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:58.227854 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e390f51-e65c-441b-9ee3-52eb649762e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:58.242878 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e390f51-e65c-441b-9ee3-52eb649762e5 None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:58.243732 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e390f51-e65c-441b-9ee3-52eb649762e5 None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:58.260296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.compute.rpcapi [None req-5e390f51-e65c-441b-9ee3-52eb649762e5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 15:18:58.267042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e390f51-e65c-441b-9ee3-52eb649762e5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118273) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 15:18:58.380505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5e390f51-e65c-441b-9ee3-52eb649762e5 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.674345 Jun 24 15:18:58.380505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 36/60] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:18:58.390719 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:58.391574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:58.407786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:58.409972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:58.413079 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:58.413967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:58.633804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:58.642728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:58.659112 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:58.663090 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0973b3d1-f1ab-4a4c-a7ab-a1636ea70239 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1340 microversion: 2.20 time: 0.277807 Jun 24 15:18:58.681798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 25/61] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:18:58 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1340 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:18:58.703223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:58.704009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:58.717834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:58.718340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:58.719129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:58.723304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:59.165538 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:59.174368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-13cd91dd-346e-4b31-bebb-717893a196bf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.475973 Jun 24 15:18:59.178820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 37/62] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:58 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:59.210502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:59.211117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:59.217783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:59.218237 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:59.223236 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:59.223699 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:59.445220 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:59.451849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d6453a74-5001-4f2d-ba99-cdb00189388c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.245803 Jun 24 15:18:59.452682 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 26/63] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:18:59 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:18:59.691631 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:18:59.692352 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:18:59.700345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:59.701169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:59.702555 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:18:59.704498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:18:59.816722 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:59.828273 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:59.832839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:18:59.832839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d0f25999-9f37-4723-92ef-4c8f47b2f61a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1338 microversion: 2.20 time: 0.143436 Jun 24 15:18:59.841541 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 38/64] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:18:59 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1338 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:00.029515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-f038c60b-08a4-48aa-ba64-e6629aba4e4b req-29f75587-0754-4f00-a6b7-8bc03a393da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a390f9-db97-4a41-a7df-e71f3d5c9ceb", "tag": "8cf89439-cc2e-4f42-bff5-bf72f779218b"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:00.041801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f038c60b-08a4-48aa-ba64-e6629aba4e4b req-29f75587-0754-4f00-a6b7-8bc03a393da0 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.042250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f038c60b-08a4-48aa-ba64-e6629aba4e4b req-29f75587-0754-4f00-a6b7-8bc03a393da0 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.061101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-f038c60b-08a4-48aa-ba64-e6629aba4e4b req-29f75587-0754-4f00-a6b7-8bc03a393da0 service nova] Creating event network-changed:8cf89439-cc2e-4f42-bff5-bf72f779218b for instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb on hv-cinder-83538 Jun 24 15:19:00.061621 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f038c60b-08a4-48aa-ba64-e6629aba4e4b req-29f75587-0754-4f00-a6b7-8bc03a393da0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 15:19:00.062678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-950d84e2-ec5e-4bb8-bf6d-d6c52fb3a73a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.063118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-950d84e2-ec5e-4bb8-bf6d-d6c52fb3a73a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.063930 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-950d84e2-ec5e-4bb8-bf6d-d6c52fb3a73a None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.064365 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-950d84e2-ec5e-4bb8-bf6d-d6c52fb3a73a None None] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.073078 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.compute.rpcapi [None req-950d84e2-ec5e-4bb8-bf6d-d6c52fb3a73a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 15:19:00.073945 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-950d84e2-ec5e-4bb8-bf6d-d6c52fb3a73a None None] Releasing lock "compute-rpcapi-router" {{(pid=118274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 15:19:00.089553 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-950d84e2-ec5e-4bb8-bf6d-d6c52fb3a73a None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123703 Jun 24 15:19:00.090468 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 27/65] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:00.191481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:00.192202 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:00.198184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.198625 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.199409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.199842 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.352217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:00.368958 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0e1cbb8a-0f5d-4dc3-899f-cf950c83ee25 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.181008 Jun 24 15:19:00.370704 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 39/66] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:00 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:00.454795 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-a3d30b00-f864-4c7f-970d-e61555b51bf2 req-ab200066-b3ef-4152-987e-3bf5b60710bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72dcf091-51b8-4200-86d7-002dde49e07c", "tag": "cdb31b17-1cea-4ead-bfa9-8e2eaf5beea8"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:00.463984 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a3d30b00-f864-4c7f-970d-e61555b51bf2 req-ab200066-b3ef-4152-987e-3bf5b60710bb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.469623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:00.470237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:00.473883 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a3d30b00-f864-4c7f-970d-e61555b51bf2 req-ab200066-b3ef-4152-987e-3bf5b60710bb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.487628 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.488323 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.489273 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.491818 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.510252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-a3d30b00-f864-4c7f-970d-e61555b51bf2 req-ab200066-b3ef-4152-987e-3bf5b60710bb service nova] Creating event network-changed:cdb31b17-1cea-4ead-bfa9-8e2eaf5beea8 for instance 72dcf091-51b8-4200-86d7-002dde49e07c on hv-cinder-83538 Jun 24 15:19:00.522495 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-a3d30b00-f864-4c7f-970d-e61555b51bf2 req-ab200066-b3ef-4152-987e-3bf5b60710bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070385 Jun 24 15:19:00.524246 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 28/67] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:00.705082 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:00.712867 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-faa19b91-9bdd-4c8d-b530-179d4fb1f61e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.247328 Jun 24 15:19:00.713444 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 40/68] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:00 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:00.849303 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:00.849991 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:00.856210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.856661 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.857425 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:00.857859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:00.955834 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:00.964487 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:00.966200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:00.967470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-30640010-7157-44ba-a33b-bf5769c46811 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1338 microversion: 2.20 time: 0.122542 Jun 24 15:19:00.978391 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 29/69] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:00 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1338 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:01.387587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:01.388052 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:01.394115 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:01.394605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:01.395397 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:01.395829 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:01.557918 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:01.569144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d4a84a71-c7ad-4299-8ebf-1ea5a66fcfc7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.185548 Jun 24 15:19:01.582476 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 41/70] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:01 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:01.733815 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:01.734440 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:01.736650 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:01.743778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:01.744496 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:01.745458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:01.746219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:01.749793 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=63 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:01.926973 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:01.935153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d182e03-11de-47ea-b793-d5528aeae608 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.205118 Jun 24 15:19:01.936027 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 30/71] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:01 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:01.986166 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:01.986871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:01.993064 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:01.993509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:01.994269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:01.994697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:02.091214 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:02.091214 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:02.099840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:02.101344 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:02.102489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fd8eddee-413f-45da-8ed9-f71f466ee10e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1338 microversion: 2.20 time: 0.120322 Jun 24 15:19:02.103035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 42/72] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:01 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1338 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:02.596850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:02.598168 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:02.630951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:02.637181 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:02.638147 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:02.638584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:02.917992 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:02.929623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ed348ae-bb68-4e0e-b1ff-71df52b4bbc1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.336628 Jun 24 15:19:02.931086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 31/73] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:02 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:02.953097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:02.953706 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:02.960390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:02.960847 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:02.961627 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:02.962064 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:03.121668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:03.122531 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:03.131038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:03.131968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:03.132986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:03.133632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:03.207624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:03.215961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-144bab9e-b3eb-450e-818f-f634500b6364 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.266963 Jun 24 15:19:03.221165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 43/74] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:02 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:03.227783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:03.236468 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:03.238891 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:03.240305 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1a253a2c-cc0e-436d-8b27-a01965130d3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1338 microversion: 2.20 time: 0.122927 Jun 24 15:19:03.251679 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 32/75] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:03 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1338 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:03.946426 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:03.947366 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:03.964794 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:03.965896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:03.967029 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:03.973622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:04.234471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:04.235086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:04.241504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=30 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:04.244187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:04.244804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:04.245743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:04.246176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:04.262381 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:04.276587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2a2cbe5d-6599-45b4-9af3-f44cd8547c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.334560 Jun 24 15:19:04.291005 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 44/76] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:03 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:04.306935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:04.307730 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:04.320864 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:04.321392 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:04.322651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:04.323303 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:04.430512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:04.438516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-21c17520-6393-43c9-9e70-b1cbc03b7567 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.208399 Jun 24 15:19:04.447935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 33/77] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:04 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:04.472586 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:04.481364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:04.482972 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:04.484318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7f3e1fb5-ad6d-4f17-b0d9-1193c9892f81 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1338 microversion: 2.20 time: 0.183777 Jun 24 15:19:04.484863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 45/78] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:04 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1338 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:05.299840 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:05.303221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:05.314818 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:05.317144 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:05.326608 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:05.327334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:05.457142 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:05.457781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:05.459852 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=14 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:05.470998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:05.475820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:05.477270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:05.477957 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:05.598336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:05.608845 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-225b946d-29f6-49ad-a319-93df664517d1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.313899 Jun 24 15:19:05.610271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 34/79] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:05 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:05.625224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:05.625224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:05.628194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:05.629413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:05.630375 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:05.630817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:05.732749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:05.734289 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:05.743678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:05.744896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-42dc10eb-ebd8-4c34-8871-2c9b97739aed tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.292055 Jun 24 15:19:05.745192 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:05.746295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5643630f-9764-4e4d-b990-63382c07b457 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1338 microversion: 2.20 time: 0.134702 Jun 24 15:19:05.747937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 35/81] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:05 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:05.748330 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 46/81] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:05 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:06.633099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:06.633099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:06.640678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:06.643826 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:06.645369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:06.647721 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:06.764039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:06.764649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:06.773377 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:06.773828 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:06.775506 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:06.777784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:06.911299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:06.918737 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-003f9d49-f20b-43d4-b669-7464b6ca5319 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.296179 Jun 24 15:19:06.919356 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 36/82] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:06 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:06.923732 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:06.924330 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:06.930661 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:06.931110 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:06.931908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:06.932345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:06.966365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:06.977250 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:06.978912 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:06.979998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-49013ea2-7771-4f39-95ac-6c33d022fc6f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1338 microversion: 2.20 time: 0.219714 Jun 24 15:19:06.980732 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 47/83] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:06 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1338 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:07.160504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:07.187501 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-255f3abf-c721-4b01-a626-393045415447 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.267067 Jun 24 15:19:07.191578 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 37/84] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:06 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:07.935977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:07.936607 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:07.938452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:07.943690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:07.944128 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:07.945073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:07.945655 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:08.000041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:08.000656 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:08.007596 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:08.008249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:08.009229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:08.009849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:08.133388 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:08.144754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-466ad305-effe-46fa-9ed3-c388cb71cc24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.209331 Jun 24 15:19:08.144754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 48/85] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:07 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:08.197794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:08.204329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:08.206270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:08.206983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:08.208274 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:08.209394 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1ac7e011-66c7-4e6d-acfb-0eda01aaba7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.214160 Jun 24 15:19:08.210233 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 38/86] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:07 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:08.211813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:08.212323 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:08.213158 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:08.213659 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:08.255552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:08.346545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:08.352753 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4c1ff26c-b950-4e1f-9059-ea120039170e tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.152218 Jun 24 15:19:08.353319 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 49/87] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:08 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:09.159098 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:09.159846 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:09.166079 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:09.166528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:09.167727 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:09.167727 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:09.229835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:09.231501 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:09.244412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:09.245179 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:09.246289 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:09.247065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:09.358343 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:09.367947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c3b06a29-6c5f-417b-b28e-48576ec2cc41 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.212886 Jun 24 15:19:09.371491 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 39/88] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:09 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:09.376866 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:09.377650 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:09.384252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:09.384923 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:09.385867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:09.386448 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:09.576697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:09.586600 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:09.588384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:09.597743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:09.598238 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eacd3521-f54f-4c7e-9f79-432984fc0496 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.365515 Jun 24 15:19:09.603385 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 50/89] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:09 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:09.604140 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8b26101f-4809-46f5-b9ab-965eed41a1aa tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.231372 Jun 24 15:19:09.604746 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 40/90] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:09 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:10.387029 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:10.387029 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:10.397663 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:10.398700 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:10.399967 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:10.402553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:10.620912 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:10.621540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:10.623729 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=10 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:10.630410 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:10.630902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:10.631787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:10.632225 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:11.032756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:11.040570 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d75ff381-d86e-43ea-a7a3-8bd0df596490 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.659161 Jun 24 15:19:11.041139 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 51/91] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:10 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:11.045464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:11.045626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:11.046117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:11.061935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:11.062381 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:11.063149 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:11.063557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0428acb6-045f-4a83-91dd-eaaa29e2a65b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.446775 Jun 24 15:19:11.063669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:11.064217 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 41/92] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:10 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:11.215419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:11.224049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:11.225551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:11.226651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-050f294c-c6c9-4681-b6d7-790151e84705 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.184595 Jun 24 15:19:11.227277 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 52/93] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:11 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:12.064432 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:12.065489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:12.072858 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:12.073398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:12.074266 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:12.074904 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:12.084808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:12.084808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:12.115841 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:12.116649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:12.117803 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:12.119906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:12.396967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:12.406628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0b5b7867-b977-4651-afc7-21acf0bcc39f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.346317 Jun 24 15:19:12.407249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 42/94] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:12 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:12.411843 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:12.420015 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:12.435786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:12.436554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:12.437578 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:12.438237 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:12.439011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:12.447423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4dbb812c-dad7-48b9-8b4a-1d87321de84b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.370233 Jun 24 15:19:12.448619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 53/95] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:12 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:12.616306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:12.630355 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:12.642325 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:12.643912 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-72729da5-a90b-461d-b201-36a29e0829fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.235647 Jun 24 15:19:12.644682 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 43/96] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:12 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:12.695266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-82af4a68-0865-4678-97be-17b10dd825fd req-693df4f4-268c-4cae-87b1-535ee94394e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24b4aae-8cee-48cc-bf18-e9a915ea3f2c", "tag": "5f0c5043-24b7-4a39-9766-66475f0cad69"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:12.708073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-82af4a68-0865-4678-97be-17b10dd825fd req-693df4f4-268c-4cae-87b1-535ee94394e5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:12.708978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-82af4a68-0865-4678-97be-17b10dd825fd req-693df4f4-268c-4cae-87b1-535ee94394e5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:12.734907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-82af4a68-0865-4678-97be-17b10dd825fd req-693df4f4-268c-4cae-87b1-535ee94394e5 service nova] Creating event network-changed:5f0c5043-24b7-4a39-9766-66475f0cad69 for instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c on hv-cinder-83538 Jun 24 15:19:12.741982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-82af4a68-0865-4678-97be-17b10dd825fd req-693df4f4-268c-4cae-87b1-535ee94394e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056278 Jun 24 15:19:12.743061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 54/97] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:13.424703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:13.424703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:13.433695 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:13.434552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:13.436036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:13.436631 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:13.468170 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:13.469499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:13.483748 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:13.484197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:13.486463 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:13.486463 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:13.710113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:13.723472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8a893e8f-4ac7-4004-8ac4-ef342654c291 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.303482 Jun 24 15:19:13.724334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 44/98] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:13 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:13.735404 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:13.744292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:13.744901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:13.748910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-521c4c24-34ea-4eb4-9daf-ef8d2c088ad4 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.286162 Jun 24 15:19:13.750823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 55/99] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:13 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:13.768111 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:13.768571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:13.770126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:13.770852 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:13.955287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:13.965016 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:13.967205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:13.968349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-03b72bd7-4ab9-429b-9390-648f0014e486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.237962 Jun 24 15:19:13.968961 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 45/100] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:13 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:14.742684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:14.744075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:14.756438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:14.756891 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:14.758935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:14.761689 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:14.822466 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-3b8bc408-97d9-412e-8e03-f6b06a9517fa req-c839b96b-c98c-4a4c-92b5-80fc70903da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cb33d2-4d1f-4910-82a0-2ace0cc1144b", "name": "network-vif-plugged", "status": "completed", "tag": "471abd13-dcca-4d97-83ff-7d113a0b2e5b"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:14.832125 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-3b8bc408-97d9-412e-8e03-f6b06a9517fa req-c839b96b-c98c-4a4c-92b5-80fc70903da0 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:14.832609 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-3b8bc408-97d9-412e-8e03-f6b06a9517fa req-c839b96b-c98c-4a4c-92b5-80fc70903da0 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:14.845737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-3b8bc408-97d9-412e-8e03-f6b06a9517fa req-c839b96b-c98c-4a4c-92b5-80fc70903da0 service nova] Creating event network-vif-plugged:471abd13-dcca-4d97-83ff-7d113a0b2e5b for instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b on hv-cinder-83538 Jun 24 15:19:14.852700 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-3b8bc408-97d9-412e-8e03-f6b06a9517fa req-c839b96b-c98c-4a4c-92b5-80fc70903da0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128818 Jun 24 15:19:14.854263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 56/101] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:19:14.860766 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:14.861460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:14.869049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:14.869501 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:14.871159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:14.871705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:15.125169 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:15.131744 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:15.134172 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f3fd9322-1fb1-40f6-8c73-b2d40ae6ced0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.396219 Jun 24 15:19:15.135359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 46/102] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:14 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:15.155123 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:15.155123 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:15.184708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:15.184708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:15.184708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:15.184708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:15.488882 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:15.497977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-911e04df-fba8-4caa-a3de-773071b43ec2 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.642181 Jun 24 15:19:15.510486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 57/103] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:14 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:15.592206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:15.600262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:15.601757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:15.602859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d258412e-f1e7-410d-9ced-0b424f61614c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.464850 Jun 24 15:19:15.603625 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 47/104] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:15 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:16.153189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:16.160617 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:16.163143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:16.163785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:16.164696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:16.165271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:16.418063 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:16.426378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c9af4df7-e376-4fb2-865a-8af618ab7a3d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.277873 Jun 24 15:19:16.426952 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 58/105] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:16 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:16.516074 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:16.516696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:16.527437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:16.529130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:16.535413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:16.535413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:16.621937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:16.622565 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:16.636060 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:16.636618 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:16.637702 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:16.638073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:16.794922 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:16.808219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6b32d9b2-a883-40f9-881d-5b697e4e365f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.296194 Jun 24 15:19:16.811087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 48/106] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:16 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:16.835260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:16.845662 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:16.847383 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:16.855323 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ff448df-c52f-4bac-9608-d93b6e42ebcb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.230598 Jun 24 15:19:16.855323 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 59/107] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:16 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:17.443614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:17.444230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:17.450995 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:17.454124 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:17.454124 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:17.454124 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:17.620128 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:17.628441 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3a11ffa7-48c8-4631-a23b-4a21d9921b59 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.188685 Jun 24 15:19:17.629187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 49/108] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:17 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:17.829093 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:17.829705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:17.837652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:17.837652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:17.838287 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:17.838726 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:17.869956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:17.870720 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:17.877116 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:17.877853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:17.879474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:17.879914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:18.054874 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:18.058172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:18.062394 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:18.068130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:18.072910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:18.072910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a3168f2b-fa5a-45ec-9d08-fe12aee99e67 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.205049 Jun 24 15:19:18.072910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 50/109] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:17 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:18.075800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dc5d609b-313a-4cc5-a687-68e014e7f3e6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.250494 Jun 24 15:19:18.076364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 60/110] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:17 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:18.647571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:18.648319 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:18.654723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:18.655491 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:18.656591 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:18.657096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:18.825229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:18.834010 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eaa8f1e9-97fd-42af-ba3e-cbdf36e595e1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.191641 Jun 24 15:19:18.834692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 51/111] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:18 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:19.091650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:19.094777 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:19.102342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:19.103124 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:19.104247 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:19.104872 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:19.113941 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:19.114768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:19.122419 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:19.122918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:19.124258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:19.125250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:19.309944 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:19.314544 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:19.318580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:19.320103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:19.321195 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d0c10881-60f4-4a9c-a581-cb2a50f435f5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.236381 Jun 24 15:19:19.321746 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 61/112] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:19 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:19.327247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0917ba10-ab61-491b-a673-fee6b61cbc99 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.218910 Jun 24 15:19:19.327247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 52/113] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:19 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:19.851165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:19.851860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:19.858947 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:19.859427 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:19.861798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:19.861798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:19.994092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:20.001448 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3e83a4c5-7c97-49d5-b777-dca1f2b1aedc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.155116 Jun 24 15:19:20.002014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 62/114] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:19 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:20.339703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:20.340315 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:20.341602 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:20.342278 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:20.347195 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:20.347872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:20.353850 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:20.353975 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:20.354068 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:20.354152 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:20.354237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:20.354237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:20.620728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:20.637266 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:20.638836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:20.645764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8978569b-7a45-4c30-a492-68f3981eae52 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.308836 Jun 24 15:19:20.647675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 53/115] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:20 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:20.660197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:20.668146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4976fcfb-a365-423f-ba5c-69cdfbb29d64 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.330973 Jun 24 15:19:20.678730 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 63/116] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:20 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:20.842764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-4037917c-5bd6-4f92-b082-6a975d8996ba req-f00ed38a-4f85-48af-a625-b08cc078ff4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72dcf091-51b8-4200-86d7-002dde49e07c", "name": "network-vif-plugged", "status": "completed", "tag": "cdb31b17-1cea-4ead-bfa9-8e2eaf5beea8"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:20.851968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4037917c-5bd6-4f92-b082-6a975d8996ba req-f00ed38a-4f85-48af-a625-b08cc078ff4b service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:20.854877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4037917c-5bd6-4f92-b082-6a975d8996ba req-f00ed38a-4f85-48af-a625-b08cc078ff4b service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:20.864888 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-4037917c-5bd6-4f92-b082-6a975d8996ba req-f00ed38a-4f85-48af-a625-b08cc078ff4b service nova] Creating event network-vif-plugged:cdb31b17-1cea-4ead-bfa9-8e2eaf5beea8 for instance 72dcf091-51b8-4200-86d7-002dde49e07c on hv-cinder-83538 Jun 24 15:19:20.871227 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-4037917c-5bd6-4f92-b082-6a975d8996ba req-f00ed38a-4f85-48af-a625-b08cc078ff4b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033029 Jun 24 15:19:20.873982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 54/117] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:21.019895 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:21.020695 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:21.030179 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:21.031944 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:21.032991 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:21.033752 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:21.197508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:21.208398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a4b5e157-5c20-4e40-adb9-402a1e83d2cb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.193126 Jun 24 15:19:21.208971 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 64/118] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:21 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:21.666205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:21.666757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:21.675442 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:21.675656 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:21.676286 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:21.676723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:21.689165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:21.690882 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:21.709859 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:21.710553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:21.711621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:21.712391 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:21.917015 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:21.919921 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:21.926590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:21.927599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0f2c6ed3-0613-4bc2-aa66-5f5768c54534 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.245934 Jun 24 15:19:21.928169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 65/119] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:21 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:21.928293 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:21.929399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e2a5f207-fa7c-4302-816a-c5e8cda14810 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.267498 Jun 24 15:19:21.930106 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 55/120] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:21 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:22.226257 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:22.227101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:22.233220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:22.233842 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:22.234608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:22.235044 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:22.370003 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:22.377432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9e2ff652-4f30-47ae-92c1-24afa193b3dc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.155443 Jun 24 15:19:22.378557 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 66/121] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:22 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:22.944011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:22.944625 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:22.947940 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:22.948558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:22.950759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:22.951249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:22.952287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:22.952732 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:22.954572 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:22.955024 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:22.955840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:22.957137 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:23.144349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:23.148280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:23.152104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4d1f9398-711b-44ba-8a9b-0cdbc93e0509 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.212696 Jun 24 15:19:23.152764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 56/122] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:22 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:23.156533 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:23.158111 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:23.159226 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0b2beabb-fd1e-4765-bd5a-441ed3db0f59 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.215345 Jun 24 15:19:23.160234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 67/123] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:22 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:23.394403 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:23.394944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:23.401015 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:23.401466 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:23.402255 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:23.402687 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:23.535780 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:23.543609 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ba597e2e-d832-4bf9-b263-ab582316dfa9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.153184 Jun 24 15:19:23.555156 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 57/124] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:23 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:24.170655 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:24.171951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:24.185740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:24.185740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:24.185740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:24.185740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:24.186495 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:24.187332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:24.195093 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:24.195576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:24.196498 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:24.196942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:24.426791 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:24.442070 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76cc2e86-366a-4127-a80c-cad3b0460950 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1314 microversion: 2.1 time: 0.275708 Jun 24 15:19:24.443158 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 68/125] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:24 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:24.448225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-fd4a4ee7-9773-427d-b1ae-dc343d01e369 req-8153b318-d038-4250-ab78-3ee578b66a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a390f9-db97-4a41-a7df-e71f3d5c9ceb", "name": "network-vif-plugged", "status": "completed", "tag": "8cf89439-cc2e-4f42-bff5-bf72f779218b"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:24.458589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-fd4a4ee7-9773-427d-b1ae-dc343d01e369 req-8153b318-d038-4250-ab78-3ee578b66a9f service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:24.459514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-fd4a4ee7-9773-427d-b1ae-dc343d01e369 req-8153b318-d038-4250-ab78-3ee578b66a9f service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:24.466823 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:24.473487 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-fd4a4ee7-9773-427d-b1ae-dc343d01e369 req-8153b318-d038-4250-ab78-3ee578b66a9f service nova] Creating event network-vif-plugged:8cf89439-cc2e-4f42-bff5-bf72f779218b for instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb on hv-cinder-83538 Jun 24 15:19:24.477574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:24.478855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-fd4a4ee7-9773-427d-b1ae-dc343d01e369 req-8153b318-d038-4250-ab78-3ee578b66a9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Jun 24 15:19:24.479258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:24.479662 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 69/126] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:24.480530 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3368b847-ba69-4adb-90e7-bec3125bb7df tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.301995 Jun 24 15:19:24.481180 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 58/127] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:24 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:24.563096 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:24.563815 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:24.571101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:24.571601 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:24.572376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:24.572806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:24.743693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:24.754808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-586b5409-6e9e-4b5d-9f96-300f66326058 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.197101 Jun 24 15:19:24.764701 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 70/128] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:24 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:25.459414 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:25.460034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:25.466527 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:25.468478 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:25.468478 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:25.468478 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:25.498225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:25.498822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:25.505875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:25.506384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:25.507156 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:25.507622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:25.680956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:25.691798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2e409e2a-c097-4892-8655-8010132b44fd tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1501 microversion: 2.1 time: 0.236659 Jun 24 15:19:25.697315 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 59/129] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:25 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:25.706034 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:25.715294 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:25.725594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:25.725594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b1098c40-1de6-4571-af1a-336f91315fd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.223753 Jun 24 15:19:25.725594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 71/130] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:25 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:25.782207 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:25.782804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:25.789543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:25.790350 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:25.795486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:25.795486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:25.982687 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:25.992962 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-44978b1f-f928-4385-a302-a84b3115c0c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.214962 Jun 24 15:19:25.994096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 60/131] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:25 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:26.495352 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-777074ed-e29d-4b2f-b217-17e4e944cef5 req-fb848650-2df9-467d-85ff-5d76f7e9a728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24b4aae-8cee-48cc-bf18-e9a915ea3f2c", "name": "network-vif-plugged", "status": "completed", "tag": "5f0c5043-24b7-4a39-9766-66475f0cad69"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:26.503941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-777074ed-e29d-4b2f-b217-17e4e944cef5 req-fb848650-2df9-467d-85ff-5d76f7e9a728 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:26.504551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-777074ed-e29d-4b2f-b217-17e4e944cef5 req-fb848650-2df9-467d-85ff-5d76f7e9a728 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:26.515848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-777074ed-e29d-4b2f-b217-17e4e944cef5 req-fb848650-2df9-467d-85ff-5d76f7e9a728 service nova] Creating event network-vif-plugged:5f0c5043-24b7-4a39-9766-66475f0cad69 for instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c on hv-cinder-83538 Jun 24 15:19:26.523273 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-777074ed-e29d-4b2f-b217-17e4e944cef5 req-fb848650-2df9-467d-85ff-5d76f7e9a728 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Jun 24 15:19:26.523837 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 72/132] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:26.740931 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:26.741465 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:26.747574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:26.748028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:26.748786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:26.749218 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:26.885337 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:26.893280 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:26.894913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:26.896042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-22a73994-a71e-4388-b997-bf9e2f6eb580 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.159232 Jun 24 15:19:26.896594 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 61/133] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:26 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:27.011317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:27.012072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:27.018348 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:27.018920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:27.019719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:27.020187 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:27.169195 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:27.181045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5c3cf716-b31b-4906-bdff-50eb23fedde0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.174012 Jun 24 15:19:27.182189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 73/134] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:27 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:27.913843 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:27.914373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:27.920248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:27.920692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:27.921440 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:27.921869 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:28.052177 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:28.060006 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:28.061582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:28.063945 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-10947668-b700-46a8-8b2a-847074e2232e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.152840 Jun 24 15:19:28.063945 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 62/135] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:27 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:28.197663 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:28.198269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:28.204423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:28.205180 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:28.205969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:28.206399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:28.342462 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:28.350495 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-69312ad2-ea46-4ad3-a30e-d8447c50199c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.157018 Jun 24 15:19:28.351056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 74/136] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:28 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:29.081759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:29.082352 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:29.088378 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:29.088819 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:29.089585 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:29.090015 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:29.234058 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:29.242876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:29.244390 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:29.245467 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d64068ba-fff1-4a7d-9990-bb6a0856e93d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.168285 Jun 24 15:19:29.246006 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 63/137] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:29 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:29.367813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:29.368422 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:29.374643 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:29.375095 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:29.375890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:29.376325 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:29.521537 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:29.528997 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-40e313d2-3ca3-414c-aecd-0e55dd8d3e17 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.164923 Jun 24 15:19:29.529646 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 75/138] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:29 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:30.264766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:30.265426 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:30.271707 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:30.272402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:30.273603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:30.274413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:30.278344 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:30.446143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:30.455412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:30.458230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:30.459552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d5c87233-cbe9-4a00-91f8-a91f355e74a6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.198674 Jun 24 15:19:30.460249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 64/139] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:30 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:19:30.552479 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:30.553643 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:30.559852 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:30.563263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:30.563263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:30.563263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:30.710982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:30.727742 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5678d57e-9e3c-42a9-87d5-cdf928f2c547 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1322 microversion: 2.1 time: 0.178709 Jun 24 15:19:30.728568 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 76/140] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:30 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:30.778013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-212c4bf0-1491-4a66-b503-048d795ca58f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbbc5dce-9842-4f08-a140-a2bb8301a082"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:30.779248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-212c4bf0-1491-4a66-b503-048d795ca58f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:30.785794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-212c4bf0-1491-4a66-b503-048d795ca58f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:30.786507 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-212c4bf0-1491-4a66-b503-048d795ca58f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:30.787384 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-212c4bf0-1491-4a66-b503-048d795ca58f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:30.787887 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-212c4bf0-1491-4a66-b503-048d795ca58f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:31.478377 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:31.479245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:31.489761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:31.490275 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:31.491065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:31.491545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:31.653408 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:31.667506 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:31.674933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:31.674933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-574c630f-2e53-46ac-af63-9e704b95c324 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1405 microversion: 2.20 time: 0.198486 Jun 24 15:19:31.674933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 77/141] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:31 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:31.746261 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:31.746866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:31.753800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:31.754252 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:31.755012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:31.755558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:31.930061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:31.933804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:31.942696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-77ddbe27-1432-4b85-857f-0b9c8bc1c611 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1516 microversion: 2.1 time: 0.199696 Jun 24 15:19:31.943377 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 78/142] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:31 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:31.961796 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:31.962960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:31.973424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:31.974759 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:31.976548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:31.977187 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:32.042708 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lazy-loading 'flavor' on Instance uuid d1a390f9-db97-4a41-a7df-e71f3d5c9ceb {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:19:32.318032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-212c4bf0-1491-4a66-b503-048d795ca58f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "POST /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.544527 Jun 24 15:19:32.318985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 65/143] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:19:30 2022] POST /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b/os-volume_attachments => generated 194 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:32.539957 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f0995130-900d-4d6b-8581-bbe166da22d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb/action" status: 200 len: 32 microversion: 2.1 time: 0.583402 Jun 24 15:19:32.542640 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 79/144] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:19:31 2022] POST /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb/action => generated 32 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:19:32.553032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:32.553737 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:32.560428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:32.561161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:32.562143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:32.562734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:32.694100 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:32.695336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:32.702827 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:32.703768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:32.704548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:32.704983 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:32.762437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:32.772110 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-83dbe23d-b901-4e05-8830-2b8241d14f3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.224606 Jun 24 15:19:32.774505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 66/145] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:32 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:33.023089 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:33.031229 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:33.032719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:33.042845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-767e0f52-1351-4fe4-a249-2a7a0117214d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1597 microversion: 2.20 time: 0.346663 Jun 24 15:19:33.042845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 80/146] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:19:32 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1597 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:19:33.052928 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-589e13e4-bc9c-4c0d-9fa6-a3adaf45eac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:33.053423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-589e13e4-bc9c-4c0d-9fa6-a3adaf45eac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:33.055541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=74 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:33.060518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-589e13e4-bc9c-4c0d-9fa6-a3adaf45eac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:33.060967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-589e13e4-bc9c-4c0d-9fa6-a3adaf45eac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:33.061739 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-589e13e4-bc9c-4c0d-9fa6-a3adaf45eac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:33.062164 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-589e13e4-bc9c-4c0d-9fa6-a3adaf45eac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:33.214913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-589e13e4-bc9c-4c0d-9fa6-a3adaf45eac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165831 Jun 24 15:19:33.215655 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 67/147] 10.222.0.67 () {60 vars in 1315 bytes} [Fri Jun 24 15:19:33 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:19:33.791980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:33.792656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:33.806255 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:33.810601 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:33.811761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:33.812554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:34.320930 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:34.329210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-93f9e240-e828-41b0-814e-36c0e12c1072 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.542072 Jun 24 15:19:34.340245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 81/148] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:33 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:34.994310 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-f5972624-b736-4b4b-af5e-fe9dd3621bbf req-bcf6b82e-e801-479f-9828-1ceafe382727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24b4aae-8cee-48cc-bf18-e9a915ea3f2c", "tag": "5f0c5043-24b7-4a39-9766-66475f0cad69"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:35.004037 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f5972624-b736-4b4b-af5e-fe9dd3621bbf req-bcf6b82e-e801-479f-9828-1ceafe382727 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:35.004485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f5972624-b736-4b4b-af5e-fe9dd3621bbf req-bcf6b82e-e801-479f-9828-1ceafe382727 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:35.015943 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-f5972624-b736-4b4b-af5e-fe9dd3621bbf req-bcf6b82e-e801-479f-9828-1ceafe382727 service nova] Creating event network-changed:5f0c5043-24b7-4a39-9766-66475f0cad69 for instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c on hv-cinder-83538 Jun 24 15:19:35.021397 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-f5972624-b736-4b4b-af5e-fe9dd3621bbf req-bcf6b82e-e801-479f-9828-1ceafe382727 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040565 Jun 24 15:19:35.022004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 68/149] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:35.347055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:35.348653 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:35.355059 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:35.356318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:35.357405 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:35.358104 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:35.744200 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:35.777520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c68139dc-3b16-4755-a201-847707680ec3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.434321 Jun 24 15:19:35.781566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 82/150] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:35 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:36.801003 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:36.801668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:36.808879 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:36.809333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:36.813141 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:36.813588 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:37.041941 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:37.053939 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5e1e51c8-22c7-46fa-9d45-76d505056482 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.258002 Jun 24 15:19:37.057551 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 69/151] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:36 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:38.076119 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:38.077045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:38.104851 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:38.105980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:38.106623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:38.107429 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:38.281396 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:38.289619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aa00af4b-d1dd-45b9-b66a-0ecde03d5a60 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.218171 Jun 24 15:19:38.290786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 83/152] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:38 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:39.307224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:39.307836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:39.315649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:39.316470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:39.317288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:39.317765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:39.476343 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:39.482150 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-73e9efa7-3c1e-4a2d-a550-8c6c07e1ff6d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.178676 Jun 24 15:19:39.482955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 70/153] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:39 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:40.500049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:40.500690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:40.503856 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=72 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:40.507288 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:40.507740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:40.508504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:40.508939 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:40.654896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:40.667669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fc38f084-b866-413e-82c8-270e578bf881 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.171761 Jun 24 15:19:40.668253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 84/154] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:40 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:41.684579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:41.685176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:41.692691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:41.693435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:41.694219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:41.694628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:41.861207 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:41.868107 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-80f964ba-73cc-4d34-a4b0-73c0c53f6856 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.187426 Jun 24 15:19:41.869325 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 71/155] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:41 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:42.262071 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:42.262566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:42.268795 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:42.269236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:42.270026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:42.270457 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:42.298646 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:19:42.695943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-faae35a7-8b4c-471e-bc75-71545a5a49a6 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 204 len: 0 microversion: 2.1 time: 0.437325 Jun 24 15:19:42.696851 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 85/156] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:19:42 2022] DELETE /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:19:42.708757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:42.709764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:42.717637 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:42.718086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:42.718853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:42.719315 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:42.874236 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:42.886594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:42.887444 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:42.896014 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-06587917-a430-4b81-8f45-279815f09e6b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1553 microversion: 2.1 time: 0.193584 Jun 24 15:19:42.896611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 72/157] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:42 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:42.909343 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:42.909802 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:42.910640 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:42.911081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:43.051611 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:43.059025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-09b5406a-5d77-4d5b-81a4-424520be7d6f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.176691 Jun 24 15:19:43.059652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 86/158] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:42 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:43.917230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:43.917230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:43.922209 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:43.922726 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:43.923587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:43.924360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:44.077004 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:44.077612 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:44.077879 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:44.084412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:44.095347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:44.095347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:44.095347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:44.095669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2d9b7417-6111-4646-8ff9-af6da179222c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1553 microversion: 2.1 time: 0.176709 Jun 24 15:19:44.095669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 73/159] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:43 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:44.241965 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:44.249861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e8d7ec55-2c9e-4469-8abb-26e1f5552700 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.176719 Jun 24 15:19:44.250494 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 87/160] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:44 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:45.104685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:45.105292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:45.112567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:45.113016 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:45.113854 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:45.114343 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:45.269949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:45.270564 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:45.277061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:45.283033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:45.283033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:45.283033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:45.377480 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:45.389941 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9b46da00-b786-4cc9-bfc6-75b693be86f9 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1553 microversion: 2.1 time: 0.288514 Jun 24 15:19:45.401417 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 74/161] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:45 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1553 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:45.583744 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:45.594040 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0c7ebdfb-6145-4f18-90ef-223a2efd8b93 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.330153 Jun 24 15:19:45.594772 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 88/162] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:45 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:46.013588 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-85b5dc3c-3069-40ef-a8e8-056f7e953ec6 req-9fe8aeb3-20d0-4fff-a551-84f38cb03e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cb33d2-4d1f-4910-82a0-2ace0cc1144b", "name": "network-vif-deleted", "tag": "471abd13-dcca-4d97-83ff-7d113a0b2e5b"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:46.022616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-85b5dc3c-3069-40ef-a8e8-056f7e953ec6 req-9fe8aeb3-20d0-4fff-a551-84f38cb03e7a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:46.022988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-85b5dc3c-3069-40ef-a8e8-056f7e953ec6 req-9fe8aeb3-20d0-4fff-a551-84f38cb03e7a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:46.036014 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-85b5dc3c-3069-40ef-a8e8-056f7e953ec6 req-9fe8aeb3-20d0-4fff-a551-84f38cb03e7a service nova] Creating event network-vif-deleted:471abd13-dcca-4d97-83ff-7d113a0b2e5b for instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b on hv-cinder-83538 Jun 24 15:19:46.041583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-85b5dc3c-3069-40ef-a8e8-056f7e953ec6 req-9fe8aeb3-20d0-4fff-a551-84f38cb03e7a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031724 Jun 24 15:19:46.042496 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 75/163] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:46.408839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:46.409479 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:46.415439 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:46.415858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:46.416608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:46.417053 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:46.488781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:46.498814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4045c19e-d311-4370-ad63-d4aefb2af16c tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1345 microversion: 2.1 time: 0.094706 Jun 24 15:19:46.499478 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 89/164] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:46 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:46.613373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:46.614740 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:46.622048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:46.622504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:46.623315 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:46.623759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:46.813817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:46.822003 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-08ff1ccb-c971-4578-98ff-b54091fc6ef5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.214163 Jun 24 15:19:46.822582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 76/165] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:46 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:47.516656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:47.517982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:47.524776 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:47.525487 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:47.526259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:47.526845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:47.567399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:47.568100 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:47.568754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lazy-loading 'fault' on Instance uuid a2cb33d2-4d1f-4910-82a0-2ace0cc1144b {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:19:47.619785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78195ff60f0242ada974a8e08d1f2754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6e6bc2109c44c37a0ed635b021bba7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:47.630548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9bf5bfd-312b-4432-8907-439267be1a53 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 200 len: 1350 microversion: 2.1 time: 0.117481 Jun 24 15:19:47.641406 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 90/166] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:47 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:47.840080 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:47.840593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:47.848416 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:47.848866 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:47.849974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:47.850732 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:47.889866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-965311239", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "networks": [{"uuid": "68929872-8e73-4fa4-8752-c483abf62b64"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:47.989224 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] validate_networks() for [('68929872-8e73-4fa4-8752-c483abf62b64', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:19:48.012174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:48.021224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7293fc54-e877-45f1-b831-bd05fdc79c12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.185154 Jun 24 15:19:48.022497 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 77/167] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:47 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:48.648830 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:48.649751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:48.657482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:48.658171 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:48.659208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:48.659750 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:48.674626 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] HTTP exception thrown: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Request method failure captured: Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b HTTP/1.1 Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXPLazlspOpqeFMn1E24IjENiHh1Nj4pFMAwxJuHnca5oMqCfwHL_veyaUibxiW5PtloFqnZNVAJD3aUOzxr0_L-T0vscs1OdgdqqZtjRbSmSX2QKD1KHrdEpqvUjLkdO8RqfkhvnYnsRchgldjRfZdeTwtH50ECND8OZfE7ylac-c Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:19:48.686872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6e6bc2109c44c37a0ed635b021bba7e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 78195ff60f0242ada974a8e08d1f2754 Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.688580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'a2cb33d2-4d1f-4910-82a0-2ace0cc1144b'} Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:19:48.690283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.692211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.693787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Returning 404 to user: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:19:48.693787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-43345afa-6c02-41d8-abe5-c56836f81d40 tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 404 len: 111 microversion: 2.1 time: 0.043577 Jun 24 15:19:48.693787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 78/168] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:48 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:19:48.715038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:19:48.715575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:19:48.716526 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:19:48.717540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:19:48.718136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:19:48.729583 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:48.730028 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:48.730913 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:48.731384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:48.757901 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Getting quotas for project b0fa019dc14d4e40a77d6b7db5cad9be. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:19:48.761934 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Getting quotas for user c95b2f1348424e6fa05c9599d4e3611a and project b0fa019dc14d4e40a77d6b7db5cad9be. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:19:48.786588 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:19:48.789788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:19:48.811342 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:48.812508 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:48.819705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:48.820214 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:48.821065 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:48.821559 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:48.834628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] HTTP exception thrown: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Request method failure captured: Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b/os-volume_attachments HTTP/1.1 Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXPLazlspOpqeFMn1E24IjENiHh1Nj4pFMAwxJuHnca5oMqCfwHL_veyaUibxiW5PtloFqnZNVAJD3aUOzxr0_L-T0vscs1OdgdqqZtjRbSmSX2QKD1KHrdEpqvUjLkdO8RqfkhvnYnsRchgldjRfZdeTwtH50ECND8OZfE7ylac-c Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:19:48.843041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6e6bc2109c44c37a0ed635b021bba7e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 78195ff60f0242ada974a8e08d1f2754 Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.844972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'server_id': 'a2cb33d2-4d1f-4910-82a0-2ace0cc1144b'} Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:19:48.846025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:48.847548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:19:48.849113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Returning 404 to user: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:19:48.849113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6aca3f38-bcf0-4edf-ac1a-6bdd9fc9039f tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037765 Jun 24 15:19:48.849113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 79/169] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:19:48 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:19:48.990146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4645d3e6-bcde-4b4e-8e80-c6da41ba47db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103931 Jun 24 15:19:48.990860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 91/170] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:19:49.001106 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4602afad-46aa-4cfd-8dd4-46c010d62b1e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:49.001753 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4602afad-46aa-4cfd-8dd4-46c010d62b1e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:49.050211 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:49.052054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:49.060962 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:49.061313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4602afad-46aa-4cfd-8dd4-46c010d62b1e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:49.061654 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:49.062940 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:49.063062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:49.069223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4602afad-46aa-4cfd-8dd4-46c010d62b1e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1213 microversion: 2.1 time: 0.071886 Jun 24 15:19:49.070004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 80/171] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:48 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:49.079670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:49.252252 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:49.260410 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8bebf276-e031-4f49-a27f-212ade6c8eb9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.217156 Jun 24 15:19:49.261336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 92/172] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:49 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:50.087963 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:50.088695 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:50.096813 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:50.097287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:50.098054 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:50.098506 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:50.160921 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:50.169263 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-89c045ac-ba8b-4f7f-8985-0511b2c354f8 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1217 microversion: 2.1 time: 0.085835 Jun 24 15:19:50.169827 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 81/173] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:50 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:50.281337 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:50.281940 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:50.288311 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:50.288762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:50.289520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:50.292527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:50.435582 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:50.443710 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7cb24dd9-b1ad-4e72-8544-bc351c3b3e77 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.166740 Jun 24 15:19:50.444276 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 93/174] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:50 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:51.186369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:51.186964 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:51.194134 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:51.194577 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:51.195427 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:51.195855 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:51.259351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:51.266681 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-42580a3b-c2b7-40d8-aecb-57e7f022b6b5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1265 microversion: 2.1 time: 0.084406 Jun 24 15:19:51.267254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 82/175] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:51 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:51.461386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:51.461993 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:51.468121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:51.468579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:51.469340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:51.469780 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:51.612763 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:51.620502 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fd12daf8-bc91-412f-ac69-98259886b647 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.162852 Jun 24 15:19:51.621072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 94/176] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:51 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:52.285293 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:52.285884 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:52.292490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:52.292958 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:52.294360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:52.294806 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:52.310765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:52.358951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:52.367907 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f450950d-c1c6-47f2-985c-65d9f5b357dc tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1265 microversion: 2.1 time: 0.087323 Jun 24 15:19:52.368413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 83/177] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:52 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:52.637938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:52.638552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:52.645008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:52.645459 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:52.646232 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:52.646671 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:52.779162 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:52.787867 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f5557314-30b3-4772-9a66-3472aefc8dd4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.153892 Jun 24 15:19:52.788614 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 95/178] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:52 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:53.384055 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:53.384668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:53.391901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:53.392893 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:53.393912 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:53.394350 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:53.458850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:53.466183 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-621455f5-5516-41ce-a388-5e7a89bf2115 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1265 microversion: 2.1 time: 0.086053 Jun 24 15:19:53.466750 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 84/179] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:53 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:53.804418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:53.805014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:53.810900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:53.811384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:53.812132 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:53.812561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:53.947349 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:53.954677 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c0b67374-6efc-4d40-a990-ad228ddac703 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.153950 Jun 24 15:19:53.955254 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 96/180] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:53 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:54.483403 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:54.483998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:54.491536 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:54.491983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:54.493220 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:54.493651 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:54.568815 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:54.576818 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e63fb044-f6c4-4c61-9641-b37375bfc155 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1265 microversion: 2.1 time: 0.097216 Jun 24 15:19:54.577466 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 85/181] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:54 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:54.973768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:54.974883 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:54.982327 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:54.983689 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:54.983689 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:54.983994 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:55.241569 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:55.250001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0a1ca685-e241-404d-9a2a-defcdb5e9a96 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.282415 Jun 24 15:19:55.250682 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 97/182] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:54 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:55.594489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:55.595131 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:55.603822 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:55.604235 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:55.608531 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:55.608531 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:55.666098 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:55.666344 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:55.672987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:55.674414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:55.675245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:55.675987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:55.692872 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] HTTP exception thrown: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Request method failure captured: Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b HTTP/1.1 Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXPLazlspOpqeFMn1E24IjENiHh1Nj4pFMAwxJuHnca5oMqCfwHL_veyaUibxiW5PtloFqnZNVAJD3aUOzxr0_L-T0vscs1OdgdqqZtjRbSmSX2QKD1KHrdEpqvUjLkdO8RqfkhvnYnsRchgldjRfZdeTwtH50ECND8OZfE7ylac-c Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:19:55.698326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6e6bc2109c44c37a0ed635b021bba7e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 78195ff60f0242ada974a8e08d1f2754 Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.709893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'a2cb33d2-4d1f-4910-82a0-2ace0cc1144b'} Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:19:55.710717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.711976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.713240 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Returning 404 to user: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:19:55.713240 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-518b16df-22ad-46d7-8228-cf22bd5f294a tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 404 len: 111 microversion: 2.1 time: 0.038156 Jun 24 15:19:55.713240 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 98/183] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:19:55 2022] DELETE /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:19:55.713240 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:55.713240 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] [instance: a2cb33d2-4d1f-4910-82a0-2ace0cc1144b] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:55.715625 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:55.716318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:55.717260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:55.718017 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:55.737230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] HTTP exception thrown: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Request method failure captured: Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b HTTP/1.1 Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXPLazlspOpqeFMn1E24IjENiHh1Nj4pFMAwxJuHnca5oMqCfwHL_veyaUibxiW5PtloFqnZNVAJD3aUOzxr0_L-T0vscs1OdgdqqZtjRbSmSX2QKD1KHrdEpqvUjLkdO8RqfkhvnYnsRchgldjRfZdeTwtH50ECND8OZfE7ylac-c Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:19:55.739636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6e6bc2109c44c37a0ed635b021bba7e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6e6bc2109c44c37a0ed635b021bba7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: d6e6bc2109c44c37a0ed635b021bba7e Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-DeleteServersTestJSON-1914753502 Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 78195ff60f0242ada974a8e08d1f2754 Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-DeleteServersTestJSON-1914753502-project Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.741072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'a2cb33d2-4d1f-4910-82a0-2ace0cc1144b'} Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:19:55.741719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. Jun 24 15:19:55.742866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:19:55.744704 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] Returning 404 to user: Instance a2cb33d2-4d1f-4910-82a0-2ace0cc1144b could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:19:55.745756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c5725cc5-7af7-4ac8-888b-73486f661a3b tempest-DeleteServersTestJSON-1914753502 tempest-DeleteServersTestJSON-1914753502-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b" status: 404 len: 111 microversion: 2.1 time: 0.041161 Jun 24 15:19:55.747150 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 99/184] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:55 2022] GET /compute/v2.1/servers/a2cb33d2-4d1f-4910-82a0-2ace0cc1144b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:19:55.916610 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:55.928622 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0983765b-6703-4859-a80c-fece7a950134 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.337231 Jun 24 15:19:55.929372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 86/185] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:55 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:19:56.268637 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:56.269855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:56.277438 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:56.278159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:56.279338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:56.279790 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:56.536832 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:56.545961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be9b05f8-79cb-4210-b183-28568ff2efa4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.281518 Jun 24 15:19:56.558751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 100/186] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:56 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:56.678975 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-062b020a-23cb-4178-9517-d848cafa7c66 req-b36e015f-cadd-4f39-8e15-56ae3363f2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac2e6a9-852e-48ae-8cda-707af3307a7e", "tag": "f25dd474-cda1-411f-a882-7ac444a93772"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:19:56.691842 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-062b020a-23cb-4178-9517-d848cafa7c66 req-b36e015f-cadd-4f39-8e15-56ae3363f2b1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:56.692291 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-062b020a-23cb-4178-9517-d848cafa7c66 req-b36e015f-cadd-4f39-8e15-56ae3363f2b1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:56.708974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-062b020a-23cb-4178-9517-d848cafa7c66 req-b36e015f-cadd-4f39-8e15-56ae3363f2b1 service nova] Creating event network-changed:f25dd474-cda1-411f-a882-7ac444a93772 for instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e on hv-cinder-83538 Jun 24 15:19:56.715587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-062b020a-23cb-4178-9517-d848cafa7c66 req-b36e015f-cadd-4f39-8e15-56ae3363f2b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040215 Jun 24 15:19:56.717186 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 87/187] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:19:56.950056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:56.950821 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:56.957721 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:56.958260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:56.959126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:56.959660 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:57.197879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:57.209424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1ff7fb32-90fc-4878-84c5-46f1906d2ab4 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.266026 Jun 24 15:19:57.211343 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 101/188] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:56 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:57.567703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:57.571127 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:57.577467 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:57.578173 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:57.581518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:57.582200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:57.833986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:57.843590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d659a4cd-2e39-41d6-9cd4-b7b0f858bb50 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.282136 Jun 24 15:19:57.847371 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 88/189] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:57 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:58.230091 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:58.232361 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:58.245961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:58.247736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:58.250464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:58.251447 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:58.449285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:58.459335 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-441ebbfe-d64b-4c68-bc6b-27382a5d8968 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.236368 Jun 24 15:19:58.459920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 102/190] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:58 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:58.860430 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:58.861618 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:58.868644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:58.869050 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:58.869807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:58.870242 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:59.017515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:59.025072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-60c6be77-f40c-4127-a4ab-8f156492c7b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.168431 Jun 24 15:19:59.025649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 89/191] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:58 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:19:59.478571 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:19:59.480309 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:19:59.487075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:59.488278 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:59.490484 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:59.491456 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:59.492846 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:19:59.493490 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:19:59.666103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:19:59.675075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-48458034-3828-49c6-bbad-1dcab0394d50 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.201145 Jun 24 15:19:59.675679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 103/192] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:19:59 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:00.042243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:00.042850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:00.046000 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:00.066742 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:00.072704 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:00.074321 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:00.077062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:00.342942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:00.352885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f4aa15f9-b9d9-438e-b962-6d34c746deee tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.314446 Jun 24 15:20:00.354373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 90/193] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:00 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:00.694270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:00.694932 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:00.712372 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:00.712876 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:00.713793 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:00.714235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:00.880138 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:00.890180 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c8137414-e25c-4e66-bea0-049f35b54143 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.201894 Jun 24 15:20:00.890764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 104/194] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:00 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:01.370102 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:01.370722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:01.388574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:01.389216 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:01.390004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:01.390432 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:01.598652 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:01.606323 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-61be0c17-1454-4a4d-ae2e-24e87dd95cca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.240436 Jun 24 15:20:01.606902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 91/195] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:01 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:01.906471 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:01.908919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:01.918127 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:01.919081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:01.920230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:01.920674 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:02.074597 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:02.083365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cff30615-44d7-4683-b17f-368851359a0e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.180814 Jun 24 15:20:02.083869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 105/196] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:01 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:02.623998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:02.624560 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:02.631751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:02.632197 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:02.632979 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:02.633408 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:02.785927 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:02.793641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5aad0c99-9209-4677-9f0b-d324bd1e3251 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.173649 Jun 24 15:20:02.794258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 92/197] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:02 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:03.100553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:03.102065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:03.114081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:03.114540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:03.116740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:03.116740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:03.269727 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:03.278824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4788a721-1006-48b3-9c20-df2910093362 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.182006 Jun 24 15:20:03.280603 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 106/198] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:03 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:03.557359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-622c11fb-c81f-4780-80c5-5149ff6372e1 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Action: 'create', calling method: .version_select at 0x7f18b2b5fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-432222609", "metadata": {"Type": "work"}}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:03.810958 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:03.811596 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:03.817780 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:03.818237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:03.819006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:03.819497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:03.954938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:03.962593 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3e069be9-1b9e-44ab-888c-fcb73c159dcf tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.155490 Jun 24 15:20:03.963199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 107/199] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:03 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:04.296832 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:04.297465 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:04.304979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:04.305430 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:04.306199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:04.306626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:04.328474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-622c11fb-c81f-4780-80c5-5149ff6372e1 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.125659 Jun 24 15:20:04.329151 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 93/200] 10.222.0.67 () {60 vars in 1155 bytes} [Fri Jun 24 15:20:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1127 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 15:20:04.340744 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-32a175d9-401e-4071-b624-e8d173462d31 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Calling method '.version_select at 0x7f18b2a103a0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:04.390768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-32a175d9-401e-4071-b624-e8d173462d31 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353" status: 200 len: 352 microversion: 2.1 time: 0.052225 Jun 24 15:20:04.394332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 94/201] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:20:04 2022] GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:20:04.466596 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:04.474690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ea4764d2-6e25-44e7-807b-adc67048fef1 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.181601 Jun 24 15:20:04.475303 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 108/202] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:04 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:04.980578 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:04.981987 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:04.989219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:04.989714 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:04.990481 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:04.990942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:05.118580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:05.126018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-21059b95-2742-40ef-9e6b-578f1eb98b4e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.149784 Jun 24 15:20:05.126589 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 95/203] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:04 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:05.400903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2c3aa809-b51a-40d7-be54-424e55b53d1b tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Calling method '.version_select at 0x7f18b22434c0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:05.450074 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2c3aa809-b51a-40d7-be54-424e55b53d1b tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353" status: 200 len: 352 microversion: 2.1 time: 0.052792 Jun 24 15:20:05.450640 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 109/204] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:20:05 2022] GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:20:05.490993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:05.491602 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:05.493451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=56 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:05.498194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:05.498647 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:05.499509 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:05.499955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:05.628924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:05.636310 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-54486b32-042d-429b-9241-18dfbe976c11 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.149146 Jun 24 15:20:05.636871 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 96/205] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:05 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:06.142407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:06.143009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:06.149134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:06.149580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:06.150332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:06.150825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:06.285549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:06.292894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c7808e9c-a30e-4908-934e-4cfef25cae81 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.154464 Jun 24 15:20:06.293450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 110/206] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:06 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:06.463417 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9f87a2eb-c9da-44e4-b862-91f88024f8b4 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Calling method '.version_select at 0x7f18b2b2cd30>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:06.516014 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9f87a2eb-c9da-44e4-b862-91f88024f8b4 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353" status: 200 len: 353 microversion: 2.1 time: 0.056345 Jun 24 15:20:06.523526 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 97/207] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:20:06 2022] GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:06.528131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-22ce61ad-5c99-44b2-9193-9910b14e7699 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Calling method '.version_select at 0x7f18b2220f70>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:06.591667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-22ce61ad-5c99-44b2-9193-9910b14e7699 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353" status: 200 len: 353 microversion: 2.1 time: 0.067221 Jun 24 15:20:06.592232 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 111/208] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:20:06 2022] GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:20:06.604379 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3a62b5e9-501d-4118-85e3-73840ef656ce tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Calling method '.version_select at 0x7f18b2b735e0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:06.653404 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:06.653980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:06.660317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:06.660769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:06.661528 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:06.661965 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:06.665935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:06.791823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:06.802005 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e348d2bd-4af7-4357-973f-230b80df5af2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.152331 Jun 24 15:20:06.802584 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 112/209] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:06 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:06.811048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-992974c3-12aa-4f1e-a2d2-8ad0bf7fef7a req-7ae93ae7-c182-4e4e-b62e-70ad9e907dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac2e6a9-852e-48ae-8cda-707af3307a7e", "name": "network-vif-plugged", "status": "completed", "tag": "f25dd474-cda1-411f-a882-7ac444a93772"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:06.822665 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3a62b5e9-501d-4118-85e3-73840ef656ce tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353" status: 202 len: 0 microversion: 2.1 time: 0.216357 Jun 24 15:20:06.822665 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 98/210] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:20:06 2022] DELETE /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:20:06.822818 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-992974c3-12aa-4f1e-a2d2-8ad0bf7fef7a req-7ae93ae7-c182-4e4e-b62e-70ad9e907dd8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:06.822818 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-992974c3-12aa-4f1e-a2d2-8ad0bf7fef7a req-7ae93ae7-c182-4e4e-b62e-70ad9e907dd8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:06.830514 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a95590b6-7258-4896-ba02-243531b6bd84 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Calling method '.version_select at 0x7f18b2a1b1f0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:06.832181 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-992974c3-12aa-4f1e-a2d2-8ad0bf7fef7a req-7ae93ae7-c182-4e4e-b62e-70ad9e907dd8 service nova] Creating event network-vif-plugged:f25dd474-cda1-411f-a882-7ac444a93772 for instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e on hv-cinder-83538 Jun 24 15:20:06.842830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-992974c3-12aa-4f1e-a2d2-8ad0bf7fef7a req-7ae93ae7-c182-4e4e-b62e-70ad9e907dd8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038749 Jun 24 15:20:06.843606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 113/211] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:06.881671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a95590b6-7258-4896-ba02-243531b6bd84 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353" status: 200 len: 352 microversion: 2.1 time: 0.055878 Jun 24 15:20:06.882243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 99/212] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:20:06 2022] GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:07.312714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:07.313621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:07.320891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:07.321342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:07.322147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:07.322586 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:07.460136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:07.467802 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be745adf-e1e1-4ca5-89b1-984b99523135 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.159485 Jun 24 15:20:07.468363 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 114/213] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:07 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:07.819438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:07.819952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:07.825899 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:07.830061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:07.830061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:07.830061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:07.896856 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e6afdeb-90a9-4005-b931-84e0dee9f054 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Calling method '.version_select at 0x7f18b22439d0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:07.959070 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:07.966544 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4ccf89b9-c10c-4357-8537-5c070d39a84d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.151666 Jun 24 15:20:07.967127 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 100/214] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:07 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:08.486784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:08.487226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:08.493352 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:08.493934 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:08.494685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:08.495115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:08.623644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:08.631655 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-34b316d4-8579-45b8-bc01-db06669ca634 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.150375 Jun 24 15:20:08.632226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 101/215] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:08 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:08.706841 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-4e6afdeb-90a9-4005-b931-84e0dee9f054 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] HTTP exception thrown: Volume d9b5ab83-6497-4cfb-9437-c0a52bd00353 could not be found. Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e6afdeb-90a9-4005-b931-84e0dee9f054 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Request method failure captured: Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 HTTP/1.1 Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdYjFVgGZXhfjelsf8808aoxv--DIs74jNALzbTdfo1VenIg3W2h3F2_Lg8a_625CXGaeS6QgvmzB-4-llcTXPDXC1T-RKlNsLTzS-aorqhYkjCZ0wQmRaRpWs_tbW0-YwJORI2W1bnHm5RxN5_eK2TgGB33WTVteDlPXHxvlmf0o04 Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 301009c4e160494d97d1913a2ae3a0d7 Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesGetTestJSON-301742428 Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:08.708914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/301009c4e160494d97d1913a2ae3a0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/301009c4e160494d97d1913a2ae3a0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_301009c4e160494d97d1913a2ae3a0d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/301009c4e160494d97d1913a2ae3a0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesGetTestJSON-301742428 Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 301009c4e160494d97d1913a2ae3a0d7 Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesGetTestJSON-301742428 Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesGetTestJSON-301742428-project Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: b3308f84d204454681b15647e0eaf059 Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesGetTestJSON-301742428-project Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Volume d9b5ab83-6497-4cfb-9437-c0a52bd00353 could not be found. Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'd9b5ab83-6497-4cfb-9437-c0a52bd00353'} Jun 24 15:20:08.715317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9b5ab83-6497-4cfb-9437-c0a52bd00353 could not be found. (HTTP 404) (Request-ID: req-850efecf-6579-495b-b121-d932a9d002fa) Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:08.716951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:20:08.718204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9b5ab83-6497-4cfb-9437-c0a52bd00353 could not be found. Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 15:20:08.719259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9b5ab83-6497-4cfb-9437-c0a52bd00353 could not be found. Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9b5ab83-6497-4cfb-9437-c0a52bd00353 could not be found. Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e6afdeb-90a9-4005-b931-84e0dee9f054 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] Returning 404 to user: Volume d9b5ab83-6497-4cfb-9437-c0a52bd00353 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4e6afdeb-90a9-4005-b931-84e0dee9f054 tempest-VolumesGetTestJSON-301742428 tempest-VolumesGetTestJSON-301742428-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353" status: 404 len: 109 microversion: 2.1 time: 0.820398 Jun 24 15:20:08.720367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 115/216] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:20:07 2022] GET /compute/v2.1/os-volumes/d9b5ab83-6497-4cfb-9437-c0a52bd00353 => generated 109 bytes in 822 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:20:08.983021 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:08.983685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:08.990803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:08.991277 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:08.992041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:08.992472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:09.125775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:09.134249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-571e5818-7c9d-4b9b-a207-8ecb9e7b869b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.155007 Jun 24 15:20:09.134831 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 102/217] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:08 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:09.649242 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:09.650410 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:09.659286 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:09.659748 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:09.660509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:09.660943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:09.808584 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:09.825175 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-10f96c96-8b10-4024-97ea-71c7efe7f48a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.179687 Jun 24 15:20:09.826059 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 116/218] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:09 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:10.151705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:10.152346 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:10.159017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:10.159540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:10.160314 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:10.160756 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:10.295246 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:10.303297 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-137f9eb8-cea4-43e1-84f9-fc732d8b23b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1313 microversion: 2.1 time: 0.155640 Jun 24 15:20:10.306011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 103/219] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:10 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:10.840249 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-00a9cefa-2185-4887-83a3-57fbce58e7ab tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Action: 'create', calling method: .version_select at 0x7f18b2243040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1425587926", "metadata": {"Type": "work"}}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:10.847451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:10.848257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:10.857592 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:10.862582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:10.862582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:10.862582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-00a9cefa-2185-4887-83a3-57fbce58e7ab tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Request method failure captured: Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 122 Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdYqxDjx1tWhmzdlSRi1wF3wlP7MGIkw5liRKWoMxS9nPN7txK20Nxkm5vTCS-mKWOunU-iqsPO8QiNta1QmrFqyPzqOBgP1aL_dnVP4XsnVbhbS7x6V5UFPpXEExUzkEWJduzKQ8zcogFZFD7DxktPFYNs6MdOd2J_ootgFVET-nZ4 Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:10.864263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c46d496716274a2ea1108b37113a3d00", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 6c85daa534624e53a0e6a589d8e68f0a Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1425587926", "metadata": {"Type": "work"}}} Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:20:10.866904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1425587926', 'metadata': {'Type': 'work'}}}} Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise error Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:10.867937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 15:20:10.873062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 15:20:10.874243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 15:20:10.874243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.874243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-00a9cefa-2185-4887-83a3-57fbce58e7ab tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:10.874243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-00a9cefa-2185-4887-83a3-57fbce58e7ab tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.150290 Jun 24 15:20:10.874243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 117/220] 10.222.0.67 () {60 vars in 1155 bytes} [Fri Jun 24 15:20:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:20:10.884878 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2d65fe0b-1c97-49aa-af28-988862bbbc07 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Action: 'create', calling method: .version_select at 0x7f18b22d1e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1075513579", "metadata": {"Type": "work"}}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2d65fe0b-1c97-49aa-af28-988862bbbc07 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Request method failure captured: Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 120 Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdYqxDjx1tWhmzdlSRi1wF3wlP7MGIkw5liRKWoMxS9nPN7txK20Nxkm5vTCS-mKWOunU-iqsPO8QiNta1QmrFqyPzqOBgP1aL_dnVP4XsnVbhbS7x6V5UFPpXEExUzkEWJduzKQ8zcogFZFD7DxktPFYNs6MdOd2J_ootgFVET-nZ4 Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:10.890807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c46d496716274a2ea1108b37113a3d00", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 6c85daa534624e53a0e6a589d8e68f0a Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1075513579", "metadata": {"Type": "work"}}} Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:20:10.892025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1075513579', 'metadata': {'Type': 'work'}}}} Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise error Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi '0' Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:10.892762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 15:20:10.893906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 15:20:10.897558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 15:20:10.897558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.897558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2d65fe0b-1c97-49aa-af28-988862bbbc07 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:10.897558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2d65fe0b-1c97-49aa-af28-988862bbbc07 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018673 Jun 24 15:20:10.897558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 118/221] 10.222.0.67 () {60 vars in 1155 bytes} [Fri Jun 24 15:20:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 15:20:10.914230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8045bf8-4c93-4c35-acef-b9ba8c54fc02 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Action: 'create', calling method: .version_select at 0x7f18b2220ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2029189111", "metadata": {"Type": "work"}}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8045bf8-4c93-4c35-acef-b9ba8c54fc02 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Request method failure captured: Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 119 Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdYqxDjx1tWhmzdlSRi1wF3wlP7MGIkw5liRKWoMxS9nPN7txK20Nxkm5vTCS-mKWOunU-iqsPO8QiNta1QmrFqyPzqOBgP1aL_dnVP4XsnVbhbS7x6V5UFPpXEExUzkEWJduzKQ8zcogFZFD7DxktPFYNs6MdOd2J_ootgFVET-nZ4 Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:10.917163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c46d496716274a2ea1108b37113a3d00", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 6c85daa534624e53a0e6a589d8e68f0a Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2029189111", "metadata": {"Type": "work"}}} Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:20:10.918356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2029189111', 'metadata': {'Type': 'work'}}}} Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise error Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi '' Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:10.919500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 15:20:10.921236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 15:20:10.922605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 15:20:10.922605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.922605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8045bf8-4c93-4c35-acef-b9ba8c54fc02 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:10.922605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c8045bf8-4c93-4c35-acef-b9ba8c54fc02 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017272 Jun 24 15:20:10.922605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 119/222] 10.222.0.67 () {60 vars in 1155 bytes} [Fri Jun 24 15:20:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:20:10.935891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-796c8f4a-c99d-4168-b031-b2a306a802b6 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Calling method '.version_select at 0x7f18b22438b0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:10.978130 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-796c8f4a-c99d-4168-b031-b2a306a802b6 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] HTTP exception thrown: Volume tempest-invalid-1366528402 could not be found. Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-796c8f4a-c99d-4168-b031-b2a306a802b6 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Request method failure captured: Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1366528402 HTTP/1.1 Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdYqxDjx1tWhmzdlSRi1wF3wlP7MGIkw5liRKWoMxS9nPN7txK20Nxkm5vTCS-mKWOunU-iqsPO8QiNta1QmrFqyPzqOBgP1aL_dnVP4XsnVbhbS7x6V5UFPpXEExUzkEWJduzKQ8zcogFZFD7DxktPFYNs6MdOd2J_ootgFVET-nZ4 Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:10.990042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c46d496716274a2ea1108b37113a3d00", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 6c85daa534624e53a0e6a589d8e68f0a Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Volume tempest-invalid-1366528402 could not be found. Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'tempest-invalid-1366528402'} Jun 24 15:20:10.991552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1366528402 could not be found. (HTTP 404) (Request-ID: req-d8eb82b8-b495-4604-9023-81db843bcbf9) Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.992351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 15:20:10.993409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1366528402 could not be found. Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:20:10.994460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1366528402 could not be found. Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1366528402 could not be found. Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-796c8f4a-c99d-4168-b031-b2a306a802b6 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Returning 404 to user: Volume tempest-invalid-1366528402 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-796c8f4a-c99d-4168-b031-b2a306a802b6 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1366528402" status: 404 len: 99 microversion: 2.1 time: 0.052914 Jun 24 15:20:10.995547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 120/223] 10.222.0.67 () {58 vars in 1217 bytes} [Fri Jun 24 15:20:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1366528402 => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 24 15:20:10.997821 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-994eb38c-0a4e-4da4-866a-29c127c4cc2d tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006281 Jun 24 15:20:10.998346 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 121/224] 10.222.0.67 () {58 vars in 1139 bytes} [Fri Jun 24 15:20:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 24 15:20:11.007987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3d5f27a5-efde-4672-b53a-adbaabbb5ef2 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003746 Jun 24 15:20:11.011217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 122/225] 10.222.0.67 () {58 vars in 1136 bytes} [Fri Jun 24 15:20:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 15:20:11.018423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e9f492cf-8289-4a36-a008-56f257abf5c5 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Calling method '.version_select at 0x7f18b22439d0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:11.042203 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:11.050270 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd7ea423-0068-4d23-95f5-0e3652c7ecc4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.211876 Jun 24 15:20:11.051012 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 104/226] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:10 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:11.321118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:11.321745 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:11.328292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:11.328799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:11.329583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:11.330720 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:11.467956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:11.470169 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:11.477295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4c471f7a-91d3-4fe3-92e8-b959d55d215b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1496 microversion: 2.1 time: 0.159964 Jun 24 15:20:11.477906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 105/227] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:11 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:11.588209 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-e9f492cf-8289-4a36-a008-56f257abf5c5 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] HTTP exception thrown: Volume 54e7f03e-9137-45fa-a071-7faad761fb95 could not be found. Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e9f492cf-8289-4a36-a008-56f257abf5c5 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Request method failure captured: Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/os-volumes/54e7f03e-9137-45fa-a071-7faad761fb95 HTTP/1.1 Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdYqxDjx1tWhmzdlSRi1wF3wlP7MGIkw5liRKWoMxS9nPN7txK20Nxkm5vTCS-mKWOunU-iqsPO8QiNta1QmrFqyPzqOBgP1aL_dnVP4XsnVbhbS7x6V5UFPpXEExUzkEWJduzKQ8zcogFZFD7DxktPFYNs6MdOd2J_ootgFVET-nZ4 Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:11.590418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c46d496716274a2ea1108b37113a3d00", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 6c85daa534624e53a0e6a589d8e68f0a Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Volume 54e7f03e-9137-45fa-a071-7faad761fb95 could not be found. Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '54e7f03e-9137-45fa-a071-7faad761fb95'} Jun 24 15:20:11.591769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54e7f03e-9137-45fa-a071-7faad761fb95 could not be found. (HTTP 404) (Request-ID: req-2b327c67-a41b-4f4c-a6f2-022c65b25c63) Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:11.592516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 15:20:11.593714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54e7f03e-9137-45fa-a071-7faad761fb95 could not be found. Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 15:20:11.595023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54e7f03e-9137-45fa-a071-7faad761fb95 could not be found. Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54e7f03e-9137-45fa-a071-7faad761fb95 could not be found. Jun 24 15:20:11.596546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:11.599726 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e9f492cf-8289-4a36-a008-56f257abf5c5 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Returning 404 to user: Volume 54e7f03e-9137-45fa-a071-7faad761fb95 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:11.607414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e9f492cf-8289-4a36-a008-56f257abf5c5 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/54e7f03e-9137-45fa-a071-7faad761fb95" status: 404 len: 109 microversion: 2.1 time: 0.587297 Jun 24 15:20:11.607414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 123/228] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:20:11 2022] DELETE /compute/v2.1/os-volumes/54e7f03e-9137-45fa-a071-7faad761fb95 => generated 109 bytes in 588 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:20:11.611347 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-298adb7e-9f03-4fdf-9597-d3c37f517a56 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Calling method '.version_select at 0x7f18b2a109d0>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:12.068222 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:12.068847 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:12.070800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:12.076146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:12.076675 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:12.077452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:12.077889 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:12.210988 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:12.216815 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-298adb7e-9f03-4fdf-9597-d3c37f517a56 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] HTTP exception thrown: Volume b96ebd85-188e-4c50-aeae-59578f7418d3 could not be found. Jun 24 15:20:12.218779 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ce209cef-5b76-4d2c-a8fe-64b24b8975b4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.155196 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-298adb7e-9f03-4fdf-9597-d3c37f517a56 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Request method failure captured: Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/os-volumes/b96ebd85-188e-4c50-aeae-59578f7418d3 HTTP/1.1 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdYqxDjx1tWhmzdlSRi1wF3wlP7MGIkw5liRKWoMxS9nPN7txK20Nxkm5vTCS-mKWOunU-iqsPO8QiNta1QmrFqyPzqOBgP1aL_dnVP4XsnVbhbS7x6V5UFPpXEExUzkEWJduzKQ8zcogFZFD7DxktPFYNs6MdOd2J_ootgFVET-nZ4 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:20:12.218918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c46d496716274a2ea1108b37113a3d00", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c46d496716274a2ea1108b37113a3d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: c46d496716274a2ea1108b37113a3d00 Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesNegativeTest-886786764 Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 6c85daa534624e53a0e6a589d8e68f0a Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesNegativeTest-886786764-project Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Volume b96ebd85-188e-4c50-aeae-59578f7418d3 could not be found. Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'b96ebd85-188e-4c50-aeae-59578f7418d3'} Jun 24 15:20:12.220867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b96ebd85-188e-4c50-aeae-59578f7418d3 could not be found. (HTTP 404) (Request-ID: req-c09757f6-d76f-4169-bbed-271580f2c1cd) Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:12.222154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 15:20:12.223333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b96ebd85-188e-4c50-aeae-59578f7418d3 could not be found. Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 15:20:12.224550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b96ebd85-188e-4c50-aeae-59578f7418d3 could not be found. Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b96ebd85-188e-4c50-aeae-59578f7418d3 could not be found. Jun 24 15:20:12.225769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:12.226391 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 124/229] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:12 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:12.226471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-298adb7e-9f03-4fdf-9597-d3c37f517a56 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] Returning 404 to user: Volume b96ebd85-188e-4c50-aeae-59578f7418d3 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:12.226471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-298adb7e-9f03-4fdf-9597-d3c37f517a56 tempest-VolumesNegativeTest-886786764 tempest-VolumesNegativeTest-886786764-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b96ebd85-188e-4c50-aeae-59578f7418d3" status: 404 len: 109 microversion: 2.1 time: 0.614140 Jun 24 15:20:12.226471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 106/230] 10.222.0.67 () {58 vars in 1244 bytes} [Fri Jun 24 15:20:11 2022] GET /compute/v2.1/os-volumes/b96ebd85-188e-4c50-aeae-59578f7418d3 => generated 109 bytes in 616 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:20:13.235722 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:13.237143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:13.244280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:13.244416 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:13.245062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:13.245489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:13.385802 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:13.393912 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2b9d6727-93c9-41e9-8e9a-ed6c8e0277d0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.161973 Jun 24 15:20:13.394482 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 125/231] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:13 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:14.410372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:14.410979 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:14.417669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:14.418119 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:14.418921 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:14.419398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:14.551843 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:14.559358 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ce0622a9-f9ca-4ce6-a8c3-74c5162a40b1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.153250 Jun 24 15:20:14.559913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 107/232] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:14 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:15.473986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:15.474478 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:15.480399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:15.480844 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:15.481594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:15.482025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:15.507043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:20:15.575999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:15.576633 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:15.584171 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:15.584827 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:15.585373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:15.585810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:15.718431 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:15.726505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a3b19f43-b842-48bb-b365-82e16f923217 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.154281 Jun 24 15:20:15.727004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 108/233] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:15 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:15.855240 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4a825cfa-c591-449f-a288-603248e0bb3e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 204 len: 0 microversion: 2.1 time: 0.384994 Jun 24 15:20:15.855867 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 126/234] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:20:15 2022] DELETE /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:20:15.864523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:15.865125 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:15.871143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:15.871625 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:15.872383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:15.873223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:16.005737 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:16.015721 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-13e0df96-4ad5-4ad9-b023-37022a037543 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1502 microversion: 2.1 time: 0.155463 Jun 24 15:20:16.025268 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 109/235] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:15 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:16.744264 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:16.744996 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:16.753117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:16.753605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:16.754367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:16.754806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:16.915022 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:16.924311 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-24bf018e-d630-440e-bc72-b9f74fc204c8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.183552 Jun 24 15:20:16.927521 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 127/236] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:16 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:17.034071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:17.034768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:17.046201 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:17.046201 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:17.046201 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:17.046201 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:17.180085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:17.187622 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-02d61244-14e6-4b20-9c67-97297a59b300 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1502 microversion: 2.1 time: 0.159169 Jun 24 15:20:17.188210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 110/237] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:17 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:17.941992 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:17.942602 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:17.948648 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:17.949102 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:17.949870 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:17.950309 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:18.153477 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:18.163083 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-33dcafa9-8982-4bc6-bb1d-46f98997ee12 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.225663 Jun 24 15:20:18.179825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 128/238] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:17 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:18.208022 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:18.209206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:18.223773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:18.223773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:18.223773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:18.223773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:18.443759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:18.452212 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a060f2b1-2344-444a-94c3-9174ac64d23b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1502 microversion: 2.1 time: 0.247978 Jun 24 15:20:18.452901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 111/239] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:18 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:18.738161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-9c0d853e-83e4-46eb-8079-467d8368637e req-a11e9d46-3a09-411a-94ae-4cbc34513759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac2e6a9-852e-48ae-8cda-707af3307a7e", "name": "network-vif-deleted", "tag": "f25dd474-cda1-411f-a882-7ac444a93772"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:18.746068 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-9c0d853e-83e4-46eb-8079-467d8368637e req-a11e9d46-3a09-411a-94ae-4cbc34513759 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:18.746499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-9c0d853e-83e4-46eb-8079-467d8368637e req-a11e9d46-3a09-411a-94ae-4cbc34513759 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:18.758417 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-9c0d853e-83e4-46eb-8079-467d8368637e req-a11e9d46-3a09-411a-94ae-4cbc34513759 service nova] Creating event network-vif-deleted:f25dd474-cda1-411f-a882-7ac444a93772 for instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e on hv-cinder-83538 Jun 24 15:20:18.763238 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-9c0d853e-83e4-46eb-8079-467d8368637e req-a11e9d46-3a09-411a-94ae-4cbc34513759 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029076 Jun 24 15:20:18.763816 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 129/240] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:19.194920 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:19.195646 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:19.201895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:19.202453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:19.203382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:19.203913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:19.349504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:19.357196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fd8a55b9-4c60-496d-a7a3-172df48f6f2c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1522 microversion: 2.1 time: 0.167038 Jun 24 15:20:19.367602 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 112/241] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:19 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:19.469304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:19.476327 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:19.488532 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:19.490735 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:19.491744 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:19.493066 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:19.607952 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:19.618442 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-baadbb1f-8f4c-480f-aa7f-4af778a81804 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 200 len: 1298 microversion: 2.1 time: 0.153227 Jun 24 15:20:19.619624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 130/242] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:19 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:20.374346 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:20.374942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:20.381403 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:20.381842 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:20.389266 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:20.390187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:20.546698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:20.556683 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-415be206-8daf-4c8a-b8e6-9bfd3e00e819 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1502 microversion: 2.1 time: 0.185477 Jun 24 15:20:20.557502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 113/243] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:20 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:20.574652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:20.576073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:20.585311 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:20.585311 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:20.585311 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:20.586068 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:20.638478 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:20.639249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 3ac2e6a9-852e-48ae-8cda-707af3307a7e] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:20.650021 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:20.651208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:20.652484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:20.653103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:20.672257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] HTTP exception thrown: Instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e could not be found. Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Request method failure captured: Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e HTTP/1.1 Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdYRLfZQhhNQvLOpxAMbp_7xX7HDtlZx8lbFmEXWtgEKgROP51Jhk8r_PZkjZiWrdpNFJR3WVSnPe1LAM0nmfV4bn9ZoSTKzCqrertDawGxZQBOc6KgmKSEdIcFmFpfV5eogUF00k2byAajdupFeTwUWCzTDv_ybuMtIOls0dGOlVsE Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: b0fa019dc14d4e40a77d6b7db5cad9be Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesActionsTest-1267001824 Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:20:20.674751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0fa019dc14d4e40a77d6b7db5cad9be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b0fa019dc14d4e40a77d6b7db5cad9be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b0fa019dc14d4e40a77d6b7db5cad9be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0fa019dc14d4e40a77d6b7db5cad9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesActionsTest-1267001824 Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: b0fa019dc14d4e40a77d6b7db5cad9be Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesActionsTest-1267001824 Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesActionsTest-1267001824-project Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: c95b2f1348424e6fa05c9599d4e3611a Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesActionsTest-1267001824-project Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e could not be found. Jun 24 15:20:20.676032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '3ac2e6a9-852e-48ae-8cda-707af3307a7e'} Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e could not be found. Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:20.676757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e could not be found. Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e could not be found. Jun 24 15:20:20.678924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:20:20.680178 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Returning 404 to user: Instance 3ac2e6a9-852e-48ae-8cda-707af3307a7e could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:20.680178 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-079c1f68-bda6-4171-90a9-c34e81ce038a tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e" status: 404 len: 111 microversion: 2.1 time: 0.044527 Jun 24 15:20:20.680920 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 114/244] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:20 2022] GET /compute/v2.1/servers/3ac2e6a9-852e-48ae-8cda-707af3307a7e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:20:20.769325 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:20.778548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a426899a-a901-4d38-8018-1db10e6aab3b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1516 microversion: 2.1 time: 0.207927 Jun 24 15:20:20.792248 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 131/245] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:20 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:20.792600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1956424688", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "networks": [{"uuid": "68929872-8e73-4fa4-8752-c483abf62b64"}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:20.929422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] validate_networks() for [('68929872-8e73-4fa4-8752-c483abf62b64', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:20:21.577299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:20:21.578262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:20:21.578926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:20:21.580051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:20:21.580629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:20:21.592208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:21.592873 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:21.593895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:21.594479 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:21.617439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Getting quotas for project b0fa019dc14d4e40a77d6b7db5cad9be. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:20:21.622341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Getting quotas for user c95b2f1348424e6fa05c9599d4e3611a and project b0fa019dc14d4e40a77d6b7db5cad9be. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:20:21.637960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:20:21.640759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:20:21.767358 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9a69cf44-13cf-452d-877f-dba22c159d57 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980613 Jun 24 15:20:21.768357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 115/246] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:20:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:20:21.785285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-23872d66-57de-473d-9c01-057c3711058b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:21.785285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-23872d66-57de-473d-9c01-057c3711058b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:21.851693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-23872d66-57de-473d-9c01-057c3711058b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:21.858929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-23872d66-57de-473d-9c01-057c3711058b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1214 microversion: 2.1 time: 0.083990 Jun 24 15:20:21.859723 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 132/247] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:21 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:22.712329 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:22.714102 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:22.723544 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:22.724320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:22.725362 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:22.726047 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:22.760992 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lazy-loading 'flavor' on Instance uuid 72dcf091-51b8-4200-86d7-002dde49e07c {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:20:22.875784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:22.877001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:22.883161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:22.884270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:22.885254 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:22.886292 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:22.955463 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:22.963039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-31219d67-43ea-406c-9f5b-d1eefbca8679 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1218 microversion: 2.1 time: 0.091087 Jun 24 15:20:22.963632 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 133/248] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:22 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:23.407043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d38782df-61b9-4000-8e26-5ff5357aaaf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c/action" status: 200 len: 32 microversion: 2.1 time: 0.697210 Jun 24 15:20:23.412313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 116/249] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:20:22 2022] POST /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c/action => generated 32 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:20:23.421463 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:23.422218 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:23.429554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:23.431050 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:23.432323 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:23.433178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:23.698213 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:23.706688 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d76a5988-ba19-47f3-bc91-6f936976becc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.289410 Jun 24 15:20:23.707276 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 134/250] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:23 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:23.987089 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:23.988603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:24.007547 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:24.007820 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:24.008660 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:24.009098 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:24.138524 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:24.146232 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f38694f2-dea0-44b9-b8a0-26754d339c8e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1266 microversion: 2.1 time: 0.167230 Jun 24 15:20:24.146817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 117/251] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:23 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:24.724522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:24.725146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:24.735083 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:24.750220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:24.751858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:24.752314 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:24.990016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:24.997413 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-afba91cd-06c4-4c00-b5ac-c4747de68d6a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.277215 Jun 24 15:20:24.998088 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 135/252] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:24 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:25.164418 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:25.166783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:25.190960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:25.191676 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:25.192445 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:25.192890 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:25.351115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:25.362275 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-027d6976-807e-4954-aba5-92c2e01d4c6e tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.201653 Jun 24 15:20:25.374205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 118/253] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:25 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:26.013823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:26.014428 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:26.022019 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:26.022571 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:26.023495 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:26.023933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:26.191135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-22ac0f5a-70e5-4013-8fce-0a169246db91 req-85ab726b-2351-4196-a090-c34f9febd3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d57783-9c2b-450c-b8f3-0d035c7eb0f6", "tag": "33fdc46a-6b68-44a6-93f0-28065add4baf"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:26.202972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-22ac0f5a-70e5-4013-8fce-0a169246db91 req-85ab726b-2351-4196-a090-c34f9febd3a3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:26.203494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-22ac0f5a-70e5-4013-8fce-0a169246db91 req-85ab726b-2351-4196-a090-c34f9febd3a3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:26.219494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-22ac0f5a-70e5-4013-8fce-0a169246db91 req-85ab726b-2351-4196-a090-c34f9febd3a3 service nova] Creating event network-changed:33fdc46a-6b68-44a6-93f0-28065add4baf for instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 on hv-cinder-83538 Jun 24 15:20:26.225079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:26.227204 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-22ac0f5a-70e5-4013-8fce-0a169246db91 req-85ab726b-2351-4196-a090-c34f9febd3a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043113 Jun 24 15:20:26.228216 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 119/254] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:26.233602 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee3edf2a-2d78-4f1a-9144-181eee072fbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.223507 Jun 24 15:20:26.244109 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 136/255] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:26 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:26.381897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:26.382807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:26.407068 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:26.411873 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:26.413043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:26.415103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:26.560689 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:26.570097 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6bfaca9c-1a2f-4abf-9b28-35d80555ac45 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.193475 Jun 24 15:20:26.570895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 120/256] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:26 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:27.253986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:27.254649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:27.263687 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:27.264217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:27.265150 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:27.265575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:27.286261 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:27.397241 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:27.404884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e1924b75-0965-434b-a737-2af2045e059b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.157021 Jun 24 15:20:27.405442 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 137/257] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:27 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:27.588527 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:27.589134 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:27.596766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:27.597115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:27.598072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:27.598541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:27.769587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:27.781571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3fa346b3-1ecc-47a0-b191-bb7868bdd148 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.196877 Jun 24 15:20:27.790807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 121/258] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:27 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:28.423042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:28.423788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:28.433492 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:28.434359 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:28.435402 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:28.435935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:28.575862 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:28.584197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-93fc3e3b-19d2-4a70-b06a-7cce766dfb4a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.165900 Jun 24 15:20:28.594260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 138/259] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:28 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:28.799628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:28.801381 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:28.808505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:28.808946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:28.809912 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:28.810630 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:28.944012 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:28.951914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9a1f5f3e-f76c-4653-b80f-188bf3b70ed5 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.157669 Jun 24 15:20:28.952695 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 122/260] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:28 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:29.601902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:29.603154 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:29.609622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:29.610077 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:29.610842 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:29.611551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:29.762102 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:29.770839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-57263475-f19d-4985-83a0-0af7561dde84 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.173160 Jun 24 15:20:29.776048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 139/261] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:29 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:29.968710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:29.969311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:29.975857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:29.976311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:29.977066 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:29.977498 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:29.992851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:30.109925 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:30.117684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8dc64633-d7d5-49aa-8145-61df3b407ce2 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.152741 Jun 24 15:20:30.118244 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 123/262] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:29 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:30.791446 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:30.791446 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:30.794580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:30.795035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:30.795848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:30.796276 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:31.076722 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:31.084384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-44d6ec94-d9cc-4c72-97ea-a31494054deb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.301226 Jun 24 15:20:31.086651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 140/263] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:30 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:31.136048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:31.136659 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:31.144518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:31.150223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:31.150223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:31.150223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:31.288335 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:31.295963 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f1970dca-fbc5-4bdf-bc7e-913ce6290acd tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.164406 Jun 24 15:20:31.297797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 124/264] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:31 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:32.112054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:32.112653 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:32.114480 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:32.119291 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:32.119736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:32.120492 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:32.120921 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:32.254106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:32.261592 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-285c047e-56ac-4a5a-9f1d-ddf003bea8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.153322 Jun 24 15:20:32.272441 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 141/265] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:32 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:32.313204 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:32.313760 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:32.315878 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:32.316570 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:32.322507 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:32.322956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:32.323745 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:32.324183 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:32.487613 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:32.495964 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-865abab8-9109-4a6a-85d8-c4a771464004 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.187060 Jun 24 15:20:32.496541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 125/266] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:32 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:32.948326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-18812b6b-460e-47da-a546-52fe6eb72c06 req-2e9a01be-e48d-44f5-bb64-b32b5dc75df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d57783-9c2b-450c-b8f3-0d035c7eb0f6", "name": "network-vif-plugged", "status": "completed", "tag": "33fdc46a-6b68-44a6-93f0-28065add4baf"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:32.960707 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-18812b6b-460e-47da-a546-52fe6eb72c06 req-2e9a01be-e48d-44f5-bb64-b32b5dc75df1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:32.961334 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-18812b6b-460e-47da-a546-52fe6eb72c06 req-2e9a01be-e48d-44f5-bb64-b32b5dc75df1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:32.973380 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-18812b6b-460e-47da-a546-52fe6eb72c06 req-2e9a01be-e48d-44f5-bb64-b32b5dc75df1 service nova] Creating event network-vif-plugged:33fdc46a-6b68-44a6-93f0-28065add4baf for instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 on hv-cinder-83538 Jun 24 15:20:32.978331 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-18812b6b-460e-47da-a546-52fe6eb72c06 req-2e9a01be-e48d-44f5-bb64-b32b5dc75df1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035872 Jun 24 15:20:32.978871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 142/267] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:33.280359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:33.281094 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:33.289607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:33.290052 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:33.290817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:33.291274 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:33.423944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:33.432154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b0d7940d-c733-47d6-b8ab-fc8e7b065f2f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.155855 Jun 24 15:20:33.432810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 126/268] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:33 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:33.514710 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:33.515536 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:33.522065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:33.522587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:33.526520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:33.526520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:33.550092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-668f6e62-b232-4df3-9518-e05503c64f71 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:33.550745 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-668f6e62-b232-4df3-9518-e05503c64f71 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:33.557136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-668f6e62-b232-4df3-9518-e05503c64f71 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:33.557530 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-668f6e62-b232-4df3-9518-e05503c64f71 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:33.558292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-668f6e62-b232-4df3-9518-e05503c64f71 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:33.558717 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-668f6e62-b232-4df3-9518-e05503c64f71 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:33.582478 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-668f6e62-b232-4df3-9518-e05503c64f71 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/ips" status: 200 len: 152 microversion: 2.20 time: 0.037133 Jun 24 15:20:33.583058 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 127/269] 10.222.0.67 () {60 vars in 1288 bytes} [Fri Jun 24 15:20:33 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:20:33.687778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:33.696033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c40b5812-19ab-4aee-8e08-f75070895faf tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.185798 Jun 24 15:20:33.698400 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 143/270] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:33 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:34.448684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:34.449222 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:34.456586 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:34.457041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:34.457811 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:34.458271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:34.598789 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:34.606518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49f7e3cb-d976-43c4-87dc-1f44c2f6ac6c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.161774 Jun 24 15:20:34.607083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 128/271] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:34 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:34.713226 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:34.713874 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:34.719949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:34.720435 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:34.721261 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:34.721719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:34.852413 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:34.859906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e382d4dc-ed41-4888-a3bf-b10d50cd2c42 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.150717 Jun 24 15:20:34.860464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 144/272] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:34 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:35.622563 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:35.623741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:35.626211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:35.634458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:35.634913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:35.635718 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:35.636165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:35.776643 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:35.784547 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-543d51be-5b66-48ec-8f0d-48b0bc11363e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.165965 Jun 24 15:20:35.785113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 129/273] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:35 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:35.877008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:35.877777 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:35.883634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:35.884075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:35.884830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:35.885259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:36.057637 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:36.067315 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fd0c83d6-9344-4a0e-bf6b-8d36ccea67db tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.194720 Jun 24 15:20:36.067877 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 145/274] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:35 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:36.802009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:36.802655 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:36.814398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:36.814398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:36.814398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:36.814398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:36.964824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:36.965376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:36.970101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:36.976885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e3cdd8c9-ff85-40d5-91b0-6e31b2ab06d4 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.179214 Jun 24 15:20:36.977752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 130/275] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:36 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:36.981193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:36.983851 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:36.984868 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:36.985467 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:37.008830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lazy-loading 'flavor' on Instance uuid e24b4aae-8cee-48cc-bf18-e9a915ea3f2c {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:20:37.085803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:37.086883 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:37.096140 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:37.096591 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:37.104712 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:37.105251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:37.275806 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:37.283768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f06e1c40-64ce-4558-9af9-75251dfd5c8f tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.203060 Jun 24 15:20:37.284336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 131/276] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:37 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:37.647834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-124799ae-6311-47f4-ab99-cc25bf6936c6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/action" status: 202 len: 0 microversion: 2.20 time: 0.687158 Jun 24 15:20:37.652889 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 146/277] 10.222.0.67 () {62 vars in 1318 bytes} [Fri Jun 24 15:20:36 2022] POST /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:20:37.661304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:37.661910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:37.667843 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:37.668288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:37.669222 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:37.669466 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:37.810387 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:37.818587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:37.820123 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:37.821277 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-82cc8b36-e20a-4945-9d2b-0797b1a4e2e4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.164968 Jun 24 15:20:37.821833 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 132/278] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:37 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:37.994328 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:37.995040 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:38.001749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:38.002199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:38.003006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:38.003468 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:38.151556 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:38.159844 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-23a6eb02-936f-4e3a-ad95-c397f7a86306 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.169800 Jun 24 15:20:38.160622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 147/279] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:37 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:38.301349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:38.301965 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:38.308114 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:38.308564 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:38.309334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:38.309772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:38.442035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:38.449740 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ff74b746-dd32-405c-914e-b5405e3dbc66 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.152556 Jun 24 15:20:38.450384 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 133/280] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:38 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:38.839884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:38.840496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:38.846771 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:38.847271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:38.848214 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:38.848658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:38.984811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:38.993370 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:38.994875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:38.996045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4bab1675-5442-4016-b0fe-bcaa46755678 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.160038 Jun 24 15:20:38.999748 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 148/281] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:38 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:39.286562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:39.286562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:39.286562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:39.286562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:39.288313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:39.288313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:39.338075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:39.338075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4f3ac5bf-c434-4403-9df3-a6ba3e09ca32 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.154448 Jun 24 15:20:39.338075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 134/282] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:39 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:39.468552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:39.469232 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:39.476141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:39.476596 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:39.477388 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:39.477824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:39.610274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:39.618219 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f3bd0a21-8ca7-4d1c-92e4-d306c6272154 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.153517 Jun 24 15:20:39.618780 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 149/283] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:39 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:40.015120 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:40.015751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:40.031540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:40.031540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:40.031540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:40.031540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:40.185684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:40.195202 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:40.196698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:40.197872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6b68c5b0-03ee-4d15-912e-4d3491fa8b70 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.186620 Jun 24 15:20:40.198421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 135/284] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:40 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:40.356236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:40.356856 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:40.363606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:40.364046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:40.364805 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:40.365245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:40.523597 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:40.531334 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-435f5b4f-3ddf-4bef-bf0a-bd8199fe2632 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.178962 Jun 24 15:20:40.531893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 150/285] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:40 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:40.636439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:40.637065 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:40.648433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:40.648936 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:40.650411 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:40.651372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:40.808580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:40.817146 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9a4efb55-b751-4bbb-b106-4d702d0d4617 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1314 microversion: 2.1 time: 0.185255 Jun 24 15:20:40.817724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 136/286] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:40 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:41.216451 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:41.217063 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:41.223416 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:41.228258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:41.228258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:41.228258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:41.351754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:41.359944 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:41.361504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:41.363268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ccaa491-164b-495c-a30a-2a7e803b99b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.150142 Jun 24 15:20:41.363825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 151/287] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:41 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:41.548256 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:41.548935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:41.555582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:41.556034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:41.556796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:41.557230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:41.688352 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:41.697279 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b674777e-4e4a-4b45-b5bc-b493b59172f6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.152772 Jun 24 15:20:41.697654 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 137/288] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:41 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:41.837687 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:41.838334 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:41.847281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:41.847811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:41.848678 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:41.849112 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:41.986525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:42.001861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:42.001861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-809adf5b-ebe8-43c9-86b5-9d0b718047f3 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1496 microversion: 2.1 time: 0.168608 Jun 24 15:20:42.003790 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 152/289] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:41 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1496 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:42.382281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:42.382988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:42.389015 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:42.389464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:42.390262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:42.390690 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:42.545196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:42.569727 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:42.569727 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:42.569727 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0e2b62ab-a9eb-43c5-9b4e-1eb8b1354512 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.189617 Jun 24 15:20:42.570460 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 138/290] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:42 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:42.715628 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:42.716231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:42.723507 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:42.723968 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:42.724740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:42.725178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:42.875339 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:42.884906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cc14f5fc-27d1-4b3f-b09d-ee87263a2ef7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.173843 Jun 24 15:20:42.895162 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 153/291] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:42 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:43.588161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:43.589680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:43.599808 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:43.600590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:43.601921 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:43.602855 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:43.759579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:43.767608 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:43.769825 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:43.771264 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a5812f54-e453-442c-ae4a-3b3171c48067 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.188436 Jun 24 15:20:43.775897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 139/292] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:43 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:43.901827 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:43.902814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:43.904618 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:43.909622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:43.910143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:43.910929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:43.911524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:44.049284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:44.057808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-54bf6f6b-5b10-4ac6-85d1-34bd6dca04d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.159821 Jun 24 15:20:44.058374 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 154/293] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:43 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:44.791819 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:44.793444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:44.801576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:44.802234 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:44.803772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:44.804224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:44.820932 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:44.949066 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:44.957380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:44.959282 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:44.960485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-abea23c4-4b07-4d60-924a-4b8125b7cfb5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.173935 Jun 24 15:20:44.961044 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 140/294] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:44 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:20:45.075630 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:45.076303 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:45.082803 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.083291 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:45.084145 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.084584 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:45.169509 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:45.170099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:45.180606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.184172 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:45.184973 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.187587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:45.233813 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:20:45.293796 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:45.301651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d534e5df-4373-4024-9bfd-814ff548f8ed tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.230005 Jun 24 15:20:45.301916 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 155/295] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:45 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:45.611003 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39255059-e73f-456d-952d-076b4487153d tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "DELETE /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 204 len: 0 microversion: 2.1 time: 0.455800 Jun 24 15:20:45.611755 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 141/296] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:20:45 2022] DELETE /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:20:45.621523 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:45.622134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:45.628919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.629595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:45.630365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.630871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:45.789551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:45.800641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-778dfebb-3fdd-4c98-9966-ea535f74e927 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1502 microversion: 2.1 time: 0.182292 Jun 24 15:20:45.801579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 156/297] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:45 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:45.979465 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:45.981133 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:45.999399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.999399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:45.999399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:45.999399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:46.186927 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:46.199570 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:46.201097 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:46.202764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c39ea8e4-b751-4c18-9aa6-e550d8e8ce9d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.227585 Jun 24 15:20:46.203425 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 142/298] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:45 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:46.318527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:46.319543 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:46.328279 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:46.328728 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:46.329960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:46.330634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:46.483227 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:46.490807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7096496d-eea3-4c53-9da1-e7174cdb371a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.176689 Jun 24 15:20:46.491411 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 157/299] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:46 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:46.840314 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:46.841455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:46.853258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:46.854045 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:46.855456 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:46.856283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.041915 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:47.051481 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8ae48120-d282-48fb-8e39-18a5d8c66a96 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1502 microversion: 2.1 time: 0.220526 Jun 24 15:20:47.052048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 143/300] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:46 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:47.221417 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:47.222206 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:47.228327 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.228779 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.229891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.230109 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.375525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:47.384312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:47.387155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:47.387155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4de81a16-a1e1-4746-a788-815d9986bd85 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.170008 Jun 24 15:20:47.387616 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 158/301] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:47 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:47.509616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:47.510494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:47.517165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.517811 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.519134 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.519741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.768595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:47.778001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-247a8dcb-dfc2-4fbd-8c6c-de7c763d6ed2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1502 microversion: 2.1 time: 0.272631 Jun 24 15:20:47.779444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 144/302] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:47 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:47.801529 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd344e32-1e00-4f69-8c7d-a70c1a979985"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:47.803697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:47.818263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.818979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.819990 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.820650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.851917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] HTTP exception thrown: Cannot 'attach_volume' instance 72dcf091-51b8-4200-86d7-002dde49e07c while it is in vm_state rescued Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Request method failure captured: Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c/os-volume_attachments HTTP/1.1 Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 74 Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXTm1kZ83vG0dVn9_eQU34jeaIS5Xs1kwFIHFrRcoFU5BwqAOFrPmil7zy7R1kti-JyFTcOryxCr-ifJqmjVaccKZqUW0NzOwvA6tjKh9i2VEhxAP-ir2UKSYsaLi_a3l93CWfiWHhabKVeTmWfW4WjSkhckXMByI88sL4WOnXU9pM Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:47.853799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6bf0e1123fa47a7844e09127fb16d6e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: b67761f9b13340a090efc1cb07714912 Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {"volumeAttachment": {"volumeId": "dd344e32-1e00-4f69-8c7d-a70c1a979985"}} Jun 24 15:20:47.855508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Cannot 'attach_volume' instance 72dcf091-51b8-4200-86d7-002dde49e07c while it is in vm_state rescued Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'server_id': '72dcf091-51b8-4200-86d7-002dde49e07c', 'body': {'volumeAttachment': {'volumeId': 'dd344e32-1e00-4f69-8c7d-a70c1a979985'}}} Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72dcf091-51b8-4200-86d7-002dde49e07c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:47.856376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 72dcf091-51b8-4200-86d7-002dde49e07c while it is in vm_state rescued Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:47.858121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:47.859542 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:20:47.859542 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:20:47.859542 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 72dcf091-51b8-4200-86d7-002dde49e07c while it is in vm_state rescued Jun 24 15:20:47.859542 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:47.859542 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Returning 409 to user: Cannot 'attach_volume' instance 72dcf091-51b8-4200-86d7-002dde49e07c while it is in vm_state rescued {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:47.860415 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8c290281-f006-4a1d-83e2-8b177b5f2df3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066064 Jun 24 15:20:47.861104 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 159/303] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:20:47 2022] POST /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 24 15:20:47.870763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ef058e02-a6a3-4f72-9f28-361a61be59b3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:47.871420 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ef058e02-a6a3-4f72-9f28-361a61be59b3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:47.882402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef058e02-a6a3-4f72-9f28-361a61be59b3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.882402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef058e02-a6a3-4f72-9f28-361a61be59b3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:47.882402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef058e02-a6a3-4f72-9f28-361a61be59b3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:47.882402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ef058e02-a6a3-4f72-9f28-361a61be59b3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.068595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:48.069447 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:48.076236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:48.076680 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.077632 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:48.078076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.135022 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ef058e02-a6a3-4f72-9f28-361a61be59b3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c/action" status: 202 len: 0 microversion: 2.1 time: 0.268332 Jun 24 15:20:48.136664 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 145/304] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:20:47 2022] POST /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:20:48.159101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:48.160693 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:48.170012 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:48.170816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.171733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:48.172369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.296967 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:48.307327 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a432d9af-9270-4752-996c-357953b996c6 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1502 microversion: 2.1 time: 0.242537 Jun 24 15:20:48.308140 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 160/305] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:48 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:20:48.419084 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:48.421024 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:48.433685 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:48.436823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.437897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:48.438571 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.748597 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:48.757632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-07a2a399-691d-454f-bb9c-20cb27f57ed7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1510 microversion: 2.1 time: 0.605834 Jun 24 15:20:48.768240 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 146/306] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:48 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:48.773878 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-52faf29a-99dd-4ea5-95ac-fd727f026089 req-c5526161-6723-4c18-88db-36c8160429cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d57783-9c2b-450c-b8f3-0d035c7eb0f6", "name": "network-vif-deleted", "tag": "33fdc46a-6b68-44a6-93f0-28065add4baf"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:48.783231 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-52faf29a-99dd-4ea5-95ac-fd727f026089 req-c5526161-6723-4c18-88db-36c8160429cb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:48.783840 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-52faf29a-99dd-4ea5-95ac-fd727f026089 req-c5526161-6723-4c18-88db-36c8160429cb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:48.821992 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-52faf29a-99dd-4ea5-95ac-fd727f026089 req-c5526161-6723-4c18-88db-36c8160429cb service nova] Creating event network-vif-deleted:33fdc46a-6b68-44a6-93f0-28065add4baf for instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 on hv-cinder-83538 Jun 24 15:20:48.831933 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-52faf29a-99dd-4ea5-95ac-fd727f026089 req-c5526161-6723-4c18-88db-36c8160429cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060325 Jun 24 15:20:48.832944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 147/307] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:48.889954 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:48.902563 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:48.904572 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:48.905748 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-65542b40-ceaa-4df7-a8a6-792f4cec07a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.504518 Jun 24 15:20:48.906299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 161/308] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:48 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:20:49.325283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:49.326062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:49.333148 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:49.333477 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:49.340723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:49.340723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:49.370428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:49.370877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:49.371360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lazy-loading 'fault' on Instance uuid 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:20:49.463010 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95b2f1348424e6fa05c9599d4e3611a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fa019dc14d4e40a77d6b7db5cad9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:49.477161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3faacf16-9c5c-4db6-aeb6-3c69da9960b7 tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 200 len: 1304 microversion: 2.1 time: 0.155840 Jun 24 15:20:49.478098 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 148/309] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:49 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:49.775791 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:49.776406 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:49.786928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:49.786928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:49.786928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:49.786928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:49.921377 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:49.924237 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:49.925306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:49.929811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0fe9e876-0448-447e-b8c9-4c847203b9d6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1510 microversion: 2.1 time: 0.157779 Jun 24 15:20:49.939583 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 162/310] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:49 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:49.941264 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:49.941264 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:49.941264 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:49.941859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:50.123068 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:50.133700 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:50.135431 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:50.139321 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b73baf9e-8005-47d1-9e39-f03a82a8a176 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.216971 Jun 24 15:20:50.139321 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 149/311] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:49 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:20:50.494992 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:50.495848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] [instance: 09d57783-9c2b-450c-b8f3-0d035c7eb0f6] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:50.505426 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:50.505868 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:50.506815 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:50.507279 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:50.522909 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] HTTP exception thrown: Instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 could not be found. Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Request method failure captured: Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 HTTP/1.1 Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdYRLfZQhhNQvLOpxAMbp_7xX7HDtlZx8lbFmEXWtgEKgROP51Jhk8r_PZkjZiWrdpNFJR3WVSnPe1LAM0nmfV4bn9ZoSTKzCqrertDawGxZQBOc6KgmKSEdIcFmFpfV5eogUF00k2byAajdupFeTwUWCzTDv_ybuMtIOls0dGOlVsE Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: b0fa019dc14d4e40a77d6b7db5cad9be Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesActionsTest-1267001824 Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:20:50.524705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0fa019dc14d4e40a77d6b7db5cad9be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b0fa019dc14d4e40a77d6b7db5cad9be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b0fa019dc14d4e40a77d6b7db5cad9be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0fa019dc14d4e40a77d6b7db5cad9be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesActionsTest-1267001824 Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: b0fa019dc14d4e40a77d6b7db5cad9be Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesActionsTest-1267001824 Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesActionsTest-1267001824-project Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: c95b2f1348424e6fa05c9599d4e3611a Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesActionsTest-1267001824-project Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 could not be found. Jun 24 15:20:50.526269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '09d57783-9c2b-450c-b8f3-0d035c7eb0f6'} Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 could not be found. Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:20:50.527126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 could not be found. Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 could not be found. Jun 24 15:20:50.528551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:20:50.529941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] Returning 404 to user: Instance 09d57783-9c2b-450c-b8f3-0d035c7eb0f6 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:20:50.529941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2341b0d5-1a41-476e-b8f6-a221ba4cce7b tempest-VolumesActionsTest-1267001824 tempest-VolumesActionsTest-1267001824-project] 10.222.0.67 "GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6" status: 404 len: 111 microversion: 2.1 time: 0.036338 Jun 24 15:20:50.529941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 163/312] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:50 2022] GET /compute/v2.1/servers/09d57783-9c2b-450c-b8f3-0d035c7eb0f6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:20:50.947625 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:50.948366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:50.954801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:50.955281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:50.956086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:50.956661 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:51.158371 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:51.160687 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:51.166267 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:51.168038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:51.168739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:51.173334 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:51.173997 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:51.174185 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d11c4f07-274e-4066-b49b-037631a9c3a3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1510 microversion: 2.1 time: 0.230181 Jun 24 15:20:51.192976 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 150/313] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:50 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:51.345858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:51.355444 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:51.357762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:51.359127 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-025f97f2-f826-405a-89cd-57a06e6c73ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.205199 Jun 24 15:20:51.359784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 164/314] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:51 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:20:52.197997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:52.198628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:52.215255 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:52.217525 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:52.218398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:52.218844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:52.378467 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:52.379873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:52.386858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:52.387333 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:52.388274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:52.389378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:52.614484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:52.631976 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9c5d5845-6af0-43a6-ab5f-b0c8d36fd607 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1516 microversion: 2.1 time: 0.441129 Jun 24 15:20:52.632570 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 151/315] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:52 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:52.747652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:52.758471 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:52.759991 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:52.761154 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90015021-76da-4360-adb5-0a012530a378 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.387310 Jun 24 15:20:52.777991 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 165/316] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:52 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:53.787955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:53.789157 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:53.797065 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:53.797517 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:53.798795 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:53.799427 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:53.983281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:54.005514 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:54.011077 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:54.012523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-768a7b1d-99ac-4b5e-b265-1032c30efbaf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.229622 Jun 24 15:20:54.013221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 152/317] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:53 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:20:55.031995 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:55.032740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:55.039002 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:55.039492 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:55.040443 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:55.040893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:55.248061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:55.256818 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:55.258536 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:55.259811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-566daa34-7d5e-40e4-b403-04ef5dfeeca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.232232 Jun 24 15:20:55.263228 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 166/318] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:55 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:56.280680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:56.281345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:56.292519 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:56.292519 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:56.294036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:56.294575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:56.574061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:56.586779 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:56.592818 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:56.594411 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1c211f4d-e8ac-46a5-9d6c-a844d340b868 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1743 microversion: 2.20 time: 0.319876 Jun 24 15:20:56.608261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 153/319] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:56 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1743 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:20:56.682072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-89d95e39-dd99-410b-a4fc-295dbfad7910 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'create', calling method: .version_select at 0x7f18b2348820>, body: {"keypair": {"name": "tempest-keypair-133571778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaByHRWLbOPmtd7Ef5CtjxX9ygOL3EIwF5uAB83JHUlH0mmJtrIe+qR8jP7ou4pDgWmHCYFmZDKp+1hTfEfod5pPVYIHLkvb4jl3JnvquR70HSBbVQxWUQHk4U5rtoDag=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:56.703503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-89d95e39-dd99-410b-a4fc-295dbfad7910 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:20:56.714695 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-89d95e39-dd99-410b-a4fc-295dbfad7910 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for user b67761f9b13340a090efc1cb07714912 and project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:20:56.849261 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-89d95e39-dd99-410b-a4fc-295dbfad7910 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189807 Jun 24 15:20:56.851938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 167/320] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:20:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:20:56.883420 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-756428001", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "networks": [{"uuid": "adb22d0d-9079-4b27-97ea-9d1017ee2036"}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:56.994940 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] validate_networks() for [('adb22d0d-9079-4b27-97ea-9d1017ee2036', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:20:57.615858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:57.617299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:57.629896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:57.670043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:57.671290 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:57.671969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:58.335500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:58.351951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:58.355036 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:58.356786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-309587c7-0191-4758-920f-26a7e4f335f1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1743 microversion: 2.20 time: 0.746749 Jun 24 15:20:58.358010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 168/321] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:57 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1743 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:20:58.447215 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:20:58.447765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:20:58.448173 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:20:58.448594 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:20:58.449009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:20:58.459909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:58.460641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:58.462185 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:58.462633 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:58.489510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Getting quotas for project 90288e11d18a4c58b77d848fdd630535. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:20:58.496872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Getting quotas for user 2321d0531bba403eb552c3a1dbb7484c and project 90288e11d18a4c58b77d848fdd630535. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:20:58.517511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:20:58.522668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:20:58.872702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-232db78b-14d7-4576-93ee-3d9caa6e8ff6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.993923 Jun 24 15:20:58.880416 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 154/322] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:20:58.887873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-708e2dff-a63b-4e3a-8ec9-ff5a5a007f96 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:58.887873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-708e2dff-a63b-4e3a-8ec9-ff5a5a007f96 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:59.051232 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-708e2dff-a63b-4e3a-8ec9-ff5a5a007f96 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:20:59.059436 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-708e2dff-a63b-4e3a-8ec9-ff5a5a007f96 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1218 microversion: 2.1 time: 0.177002 Jun 24 15:20:59.060009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 169/323] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:20:58 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:20:59.381543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:20:59.381543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:20:59.398754 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:59.399322 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:59.401483 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:59.401936 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:59.441459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:59.893066 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-b323e0b8-2717-4f37-b6d8-93ce3d2989e9 req-524118f5-b5c4-4609-9160-733d70cfc6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24b4aae-8cee-48cc-bf18-e9a915ea3f2c", "name": "network-vif-plugged", "status": "completed", "tag": "5f0c5043-24b7-4a39-9766-66475f0cad69"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:20:59.929976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b323e0b8-2717-4f37-b6d8-93ce3d2989e9 req-524118f5-b5c4-4609-9160-733d70cfc6d7 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:20:59.930571 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b323e0b8-2717-4f37-b6d8-93ce3d2989e9 req-524118f5-b5c4-4609-9160-733d70cfc6d7 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:20:59.982797 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-b323e0b8-2717-4f37-b6d8-93ce3d2989e9 req-524118f5-b5c4-4609-9160-733d70cfc6d7 service nova] Creating event network-vif-plugged:5f0c5043-24b7-4a39-9766-66475f0cad69 for instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c on hv-cinder-83538 Jun 24 15:20:59.997447 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-b323e0b8-2717-4f37-b6d8-93ce3d2989e9 req-524118f5-b5c4-4609-9160-733d70cfc6d7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107186 Jun 24 15:20:59.999225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 170/324] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:21:00.080155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-134a9427-80e1-42fe-a734-5b4cf558450c tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:00.082171 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-134a9427-80e1-42fe-a734-5b4cf558450c tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:00.271526 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-134a9427-80e1-42fe-a734-5b4cf558450c tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:00.283235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-134a9427-80e1-42fe-a734-5b4cf558450c tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1218 microversion: 2.1 time: 0.207699 Jun 24 15:21:00.284231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 171/325] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:00 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:00.294472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:00.316588 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:00.337967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:00.342453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f9205892-e425-49b9-a3ff-4335975ca6fd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.970383 Jun 24 15:21:00.346549 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 155/326] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:20:59 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:01.307503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:01.307503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:01.336036 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:01.337656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:01.338501 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:01.343724 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:01.364416 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:01.368067 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:01.399318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:01.404983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:01.406167 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:01.407746 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:01.764931 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:01.772654 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e18e9ca9-3569-4959-9af0-1042d3b0aa86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1214 microversion: 2.1 time: 0.473997 Jun 24 15:21:01.784120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 172/327] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:01 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1214 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:01.810452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-334716988", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af13b512-ccae-46a6-b2e4-3851b74c876d"}], "security_groups": [{"name": "tempest-securitygroup--2113211381"}], "key_name": "tempest-keypair-133571778", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:02.242835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:02.254836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:02.256380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:02.257567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ee222dc8-96ef-4034-82a1-61ddbd8620d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.898529 Jun 24 15:21:02.258130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 156/328] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:01 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:02.796835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:02.797533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:02.841964 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:02.842758 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:02.848962 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:02.849418 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:03.562790 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:03.576046 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5cc25ad1-e572-4272-aab4-7c9b12072ea9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1276 microversion: 2.1 time: 0.784276 Jun 24 15:21:03.578381 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 157/329] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:02 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1276 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:21:03.606352 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:03.608177 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:03.618342 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:03.632695 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:03.635829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:03.638885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:04.234912 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:04.262082 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:04.265873 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:04.272949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-02261a64-949f-45b5-b72a-d93f1423eeb6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.690663 Jun 24 15:21:04.273859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 158/330] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:03 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:04.613472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:04.614237 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:04.629666 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:04.630165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:04.631544 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:04.632161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:05.275217 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:05.289600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c409fb21-9125-4ead-a618-60b6d3464ce4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1276 microversion: 2.1 time: 0.682974 Jun 24 15:21:05.291713 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 159/331] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:04 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1276 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:05.314783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:05.322532 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:05.357836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:05.358846 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:05.362441 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:05.366771 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:06.080820 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:06.131103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:06.136024 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:06.154402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eed021c7-3bfb-4063-ab41-73f58a1c05ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.847174 Jun 24 15:21:06.163226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 160/332] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:05 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:06.387243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:06.387243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:06.387243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:06.387243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:06.388350 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:06.388350 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:06.721896 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:06.732856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b01358f8-a938-4dfd-b0e5-b5c9eb324b9a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.413663 Jun 24 15:21:06.737294 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 161/333] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:06 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:07.176005 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:07.189476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:07.189476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:07.197213 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:07.200618 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:07.201612 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:07.202277 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:07.722864 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:07.738106 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:07.739914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:07.741118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-91613732-5d8c-4413-b587-341bf5a508d2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.572012 Jun 24 15:21:07.748149 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 162/334] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:07 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:07.766851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:07.768358 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:07.778094 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:07.779610 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:07.781055 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:07.781901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:08.391211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:08.407429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0bac082a-e971-4e3f-a076-754634fd5154 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.642220 Jun 24 15:21:08.419162 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 163/335] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:07 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:21:08.768975 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:08.769696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:08.779102 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:08.794997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:08.802005 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:08.802005 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:08.802005 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:08.802005 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:09.171908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:09.188783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:09.195037 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:09.198269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-957e78b5-5fd7-4100-a02c-c6994246a1fa tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.433264 Jun 24 15:21:09.201382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 164/336] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:08 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:09.427141 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:09.428222 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:09.449857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:09.450321 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:09.451133 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:09.451588 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:09.840174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:09.851520 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bbf5b132-ffab-4765-9000-5a0e10d44823 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.429282 Jun 24 15:21:09.852096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 165/337] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:09 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:09.870891 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-224077bf-99d0-4e13-acb5-f1c002368936 req-c49deb10-7766-47ff-91e4-115ac98e0441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73badc72-7d3b-46a6-937c-aad405645904", "tag": "da0887a0-7787-4561-9520-968f8cd45bcf"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:09.916690 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-224077bf-99d0-4e13-acb5-f1c002368936 req-c49deb10-7766-47ff-91e4-115ac98e0441 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:09.917136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-224077bf-99d0-4e13-acb5-f1c002368936 req-c49deb10-7766-47ff-91e4-115ac98e0441 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:09.964995 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-224077bf-99d0-4e13-acb5-f1c002368936 req-c49deb10-7766-47ff-91e4-115ac98e0441 service nova] Creating event network-changed:da0887a0-7787-4561-9520-968f8cd45bcf for instance 73badc72-7d3b-46a6-937c-aad405645904 on hv-cinder-83538 Jun 24 15:21:09.979476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-224077bf-99d0-4e13-acb5-f1c002368936 req-c49deb10-7766-47ff-91e4-115ac98e0441 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126125 Jun 24 15:21:09.983778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 166/338] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:21:10.231326 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:10.245158 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:10.273930 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=8 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:10.280923 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:10.281382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:10.284503 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:10.311548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:10.868881 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:10.890129 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:10.891977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:10.894828 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b7fc1183-bcb4-44b3-ba07-a1a3ac0942ba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.672218 Jun 24 15:21:10.904086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 167/339] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:10 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:10.947438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:10.948509 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:10.969279 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:10.973161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:10.974038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:10.974649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:11.608844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:11.625380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6511c1d1-97b2-4e97-a849-3fef8dabbf12 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.711445 Jun 24 15:21:11.631635 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 168/340] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:10 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:11.771692 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=92 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:11.848212 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:11.925590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:11.927744 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:11.951248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:11.975019 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:11.976359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:11.977096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:13.005707 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:13.013452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:13.020937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:13.022194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8f49eb78-fd7e-4db4-aa78-27a147743f2d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 1.102509 Jun 24 15:21:13.037357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 169/341] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:11 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:13.048438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:13.061038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:13.080832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:13.083734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:13.086865 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:13.114898 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:13.825795 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:13.867008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3bf73da8-13d5-4e9b-bbab-90b9aeca31fd tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.828289 Jun 24 15:21:13.872767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 170/342] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:13 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:14.047080 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:14.051641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:14.059548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:14.062100 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:14.062100 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:14.062100 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:14.623336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:14.636691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:14.640288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:14.655766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5234d6be-74ca-4e82-b452-353a5d4eac98 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.599487 Jun 24 15:21:14.657674 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 171/343] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:14 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:14.891259 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:14.891867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:14.904625 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:14.905000 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:14.907530 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:14.908165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:15.208412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:15.210802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:15.220212 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7ca20bfa-612b-4988-a01f-ab655f4bb719 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.333501 Jun 24 15:21:15.222810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 172/344] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:14 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:15.667633 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:15.668242 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:15.693955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:15.694407 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:15.700068 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:15.700527 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:16.191923 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:16.207258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:16.209736 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:16.211875 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9dc3ca6c-b062-4ce1-b373-2c33c34a06fc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.548499 Jun 24 15:21:16.220049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 173/345] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:15 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:16.241508 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:16.246473 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:16.262893 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:16.266524 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:16.266524 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:16.272961 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:16.829136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:16.850084 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bc86bb9b-d730-4fac-8e92-2f2d501c6f86 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.614765 Jun 24 15:21:16.851254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 174/346] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:16 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:21:17.241937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:17.243267 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:17.256187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:17.256929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:17.260770 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:17.263318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:18.072975 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:18.102347 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:18.116572 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:18.125632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c56e69c1-a850-4095-be33-9d6bbcb48eae tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.887008 Jun 24 15:21:18.129947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 175/347] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:17 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:18.144508 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:18.145122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:18.179782 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:18.183326 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:18.184398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:18.187137 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:18.861605 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:18.872080 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c5625e32-9e50-4857-bb90-c0a8e089b982 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.731828 Jun 24 15:21:18.882746 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 176/348] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:18 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:19.152968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:19.154990 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:19.165990 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:19.167045 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:19.168247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:19.168826 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:19.572800 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:19.585437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:19.601503 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:19.605584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dee06553-7caf-4656-a60c-aea41e396cd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.460294 Jun 24 15:21:19.607488 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 177/349] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:19 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:19.889952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:19.891704 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:19.911426 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:19.912271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:19.913320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:19.924596 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:20.332490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:20.345038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d8843a5c-11c5-421a-a1b2-14935ba7edc7 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.459097 Jun 24 15:21:20.348649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 178/350] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:19 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:20.672907 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:20.674547 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:20.690780 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:20.693249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:20.695499 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:20.698572 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:21.015808 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:21.033583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:21.044363 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:21.046723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eb7673ec-6134-4165-bd86-0ae145d455dd tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.378654 Jun 24 15:21:21.047395 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 179/351] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:20 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:21.369138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:21.369931 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:21.376241 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:21.385976 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:21.387094 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:21.389500 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:21.645125 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] validate_networks() for [('af13b512-ccae-46a6-b2e4-3851b74c876d', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:21:21.889642 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:21.909852 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c136e63d-bd45-4c81-af56-c7d77e6e4cf6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.537909 Jun 24 15:21:21.910708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 180/352] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:21 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:21:22.070568 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:22.072649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:22.082500 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:22.083512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:22.085603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:22.091043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:22.614987 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:22.633504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:22.641477 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:22.646667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d71b1a06-3106-4857-95e4-1fa6db75325f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1738 microversion: 2.20 time: 0.582632 Jun 24 15:21:22.663586 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 181/353] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:22 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1738 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:22.725521 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:21:22.726224 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:21:22.726509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:21:22.726837 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:21:22.727264 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:21:22.746103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:22.746509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:22.749820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:22.750562 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:22.784208 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:21:22.789861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Getting quotas for user b67761f9b13340a090efc1cb07714912 and project b6bf0e1123fa47a7844e09127fb16d6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:21:22.820691 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:21:22.823407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:21:22.937189 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:22.938693 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:22.951683 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:22.952682 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:22.953755 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:22.954407 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:22.986935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2d169f2c-f9a3-45b3-a126-b30472bf4bf3 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 21.195080 Jun 24 15:21:22.993080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 173/354] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:21:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 21208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:21:23.004943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a241cd96-db78-49c9-bce5-0c834814b8d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:23.008019 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a241cd96-db78-49c9-bce5-0c834814b8d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:23.249763 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a241cd96-db78-49c9-bce5-0c834814b8d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:23.258994 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a241cd96-db78-49c9-bce5-0c834814b8d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1244 microversion: 2.1 time: 0.259897 Jun 24 15:21:23.266564 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 174/355] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:22 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1244 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:23.555505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:23.588849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-765b59eb-a188-4926-a1e4-8db04cfd61f4 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.655725 Jun 24 15:21:23.588849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 182/356] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:22 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:23.675562 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:23.675562 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:23.744136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:23.744136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:23.744136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:23.744136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:24.276856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cd7b5174-17d1-4b6a-bd5b-93f772c1e170 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:24.277476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cd7b5174-17d1-4b6a-bd5b-93f772c1e170 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:24.622085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cd7b5174-17d1-4b6a-bd5b-93f772c1e170 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:24.630657 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cd7b5174-17d1-4b6a-bd5b-93f772c1e170 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1244 microversion: 2.1 time: 0.357755 Jun 24 15:21:24.642968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 183/357] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:24 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1244 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:21:24.643404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:24.645051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:24.656551 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:24.657305 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:24.659380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:24.660623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:24.769829 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:24.787976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:24.793538 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:24.797096 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ad73e32d-4d92-4b9b-b002-e91113341b35 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1720 microversion: 2.20 time: 1.130750 Jun 24 15:21:24.799027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 175/358] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:23 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1720 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:25.102703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:25.132371 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49c3eb01-d81d-4e6b-956d-479883bf0129 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.497053 Jun 24 15:21:25.139292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 184/359] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:24 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:25.519231 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-86f64d24-2426-4e90-9a40-4d09fc3ab7fa req-babcb4b8-f34f-43c3-b413-e33dc3abe8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73badc72-7d3b-46a6-937c-aad405645904", "name": "network-vif-plugged", "status": "completed", "tag": "da0887a0-7787-4561-9520-968f8cd45bcf"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:25.535493 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-86f64d24-2426-4e90-9a40-4d09fc3ab7fa req-babcb4b8-f34f-43c3-b413-e33dc3abe8f6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:25.535493 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-86f64d24-2426-4e90-9a40-4d09fc3ab7fa req-babcb4b8-f34f-43c3-b413-e33dc3abe8f6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:25.545092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-86f64d24-2426-4e90-9a40-4d09fc3ab7fa req-babcb4b8-f34f-43c3-b413-e33dc3abe8f6 service nova] Creating event network-vif-plugged:da0887a0-7787-4561-9520-968f8cd45bcf for instance 73badc72-7d3b-46a6-937c-aad405645904 on hv-cinder-83538 Jun 24 15:21:25.550938 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-86f64d24-2426-4e90-9a40-4d09fc3ab7fa req-babcb4b8-f34f-43c3-b413-e33dc3abe8f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035914 Jun 24 15:21:25.551775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 185/360] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:21:25.669612 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ead8d85c-093c-41c9-ae82-6eff19ab765b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Action: 'create', calling method: .version_select at 0x7f18b2243670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1293239622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRiPL7whaBZ+tb33upPlCbtdg9M1veHPKw4jCjgk1RAxMtIdO8MdqM6g//jUJ7/Q36F8Hob1ZRlUAbj0qj1hxyTX7d9oT2lfEjiaDGUDPzOjpSb7QLKWCCzpFQw641qMw=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:25.676543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:25.681346 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:25.697482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:25.701916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:25.701916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:25.701916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:25.721603 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-ead8d85c-093c-41c9-ae82-6eff19ab765b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Getting quotas for project 66edbd777b48472b8fcd5a3f43c68dcc. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:21:25.731833 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-ead8d85c-093c-41c9-ae82-6eff19ab765b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Getting quotas for user bb55f38fa3c741cbb7f00e310368a85b and project 66edbd777b48472b8fcd5a3f43c68dcc. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:21:25.833696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:25.843844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b2da12ee-0205-4643-b7a5-a970c53eb659 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1296 microversion: 2.1 time: 0.197296 Jun 24 15:21:25.844446 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 186/361] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:25 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:25.857277 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:25.857876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:25.864451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:25.864818 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:25.865581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:25.866013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:25.879654 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ead8d85c-093c-41c9-ae82-6eff19ab765b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.540321 Jun 24 15:21:25.881384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 176/362] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:21:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:21:26.097829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:26.106035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:26.107781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:26.109129 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-886d9dda-032b-46f8-ac00-40fbfaf6a03f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1720 microversion: 2.20 time: 0.263439 Jun 24 15:21:26.120630 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 187/363] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:25 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1720 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:26.155019 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:26.155690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:26.164172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:26.164624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:26.165405 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:26.165896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:26.348219 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:26.356414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f12821e5-0606-4975-b328-629ab6bc7909 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.205609 Jun 24 15:21:26.356998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 177/364] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:26 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:26.867575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:26.872456 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:26.890876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:26.900242 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:26.901349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:26.901788 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:27.019899 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:27.031073 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-753375d9-b3c3-4997-8aab-e77408e8956e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1296 microversion: 2.1 time: 0.168402 Jun 24 15:21:27.031901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 188/365] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:26 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:27.130953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:27.130953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:27.137277 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:27.137752 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:27.138560 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:27.142106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:27.377722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:27.378395 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:27.386631 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:27.387077 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:27.387929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:27.388357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:27.409431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:27.429402 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:27.431668 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:27.433116 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be6985af-8d00-4680-ae29-d47d2cebd442 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1720 microversion: 2.20 time: 0.309744 Jun 24 15:21:27.434094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 178/366] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:27 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1720 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:27.571334 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-4edc2140-edc5-4760-9407-3b28af636cc7 req-90eb16d3-edc1-442d-97d2-2d49b3a68912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24b4aae-8cee-48cc-bf18-e9a915ea3f2c", "name": "network-vif-unplugged", "status": "completed", "tag": "5f0c5043-24b7-4a39-9766-66475f0cad69"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:27.592025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4edc2140-edc5-4760-9407-3b28af636cc7 req-90eb16d3-edc1-442d-97d2-2d49b3a68912 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:27.592488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4edc2140-edc5-4760-9407-3b28af636cc7 req-90eb16d3-edc1-442d-97d2-2d49b3a68912 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:27.631311 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-4edc2140-edc5-4760-9407-3b28af636cc7 req-90eb16d3-edc1-442d-97d2-2d49b3a68912 service nova] Creating event network-vif-unplugged:5f0c5043-24b7-4a39-9766-66475f0cad69 for instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c on hv-cinder-83538 Jun 24 15:21:27.648268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-4edc2140-edc5-4760-9407-3b28af636cc7 req-90eb16d3-edc1-442d-97d2-2d49b3a68912 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082191 Jun 24 15:21:27.649631 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 179/367] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:21:27.741288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:27.752547 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-da82acd4-83af-4d97-a2af-1fe968cbdeea tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.382822 Jun 24 15:21:27.757576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 189/368] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:27 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:21:28.051816 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:28.054594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:28.060746 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.061357 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.062421 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.063012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.152133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:28.161929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-be63d636-969c-4ad5-9244-b32fc92ffb30 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1302 microversion: 2.1 time: 0.116991 Jun 24 15:21:28.163341 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 180/369] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:28 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:28.452187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:28.452915 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:28.462702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.463170 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.474326 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.477059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.704170 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:28.725033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:28.727763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:28.729102 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f615a120-5372-405a-8eff-e50f300e9bf5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1723 microversion: 2.20 time: 0.280795 Jun 24 15:21:28.729667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 190/370] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:28 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:28.747603 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d894ac4b-b9d8-4465-aa4d-19637bcf0ce0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8ff1e70-2b0c-4144-9445-2fb7123ccf26"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:28.750458 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d894ac4b-b9d8-4465-aa4d-19637bcf0ce0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:28.757912 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d894ac4b-b9d8-4465-aa4d-19637bcf0ce0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.758369 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d894ac4b-b9d8-4465-aa4d-19637bcf0ce0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.759289 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d894ac4b-b9d8-4465-aa4d-19637bcf0ce0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.759675 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d894ac4b-b9d8-4465-aa4d-19637bcf0ce0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.770004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:28.770532 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:28.781388 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.781842 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.782665 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:28.783104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:28.787488 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:29.030153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:29.039093 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6fd24136-450c-4e09-9034-ad8f271937ba tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1318 microversion: 2.1 time: 0.273377 Jun 24 15:21:29.040266 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 191/371] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:28 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:29.179137 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:29.179974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:29.186257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:29.186711 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:29.187530 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:29.187969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:29.430397 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:29.438115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-594f1335-145d-41f5-a46a-697f6c8df901 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.262826 Jun 24 15:21:29.439613 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 192/372] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:29 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:30.043322 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d894ac4b-b9d8-4465-aa4d-19637bcf0ce0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.299544 Jun 24 15:21:30.045688 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 181/373] 10.222.0.67 () {62 vars in 1363 bytes} [Fri Jun 24 15:21:28 2022] POST /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 188 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:21:30.055776 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:30.057012 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:30.066696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:30.067417 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:30.069861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:30.070541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:30.287013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:30.294854 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2e6a4c9a-5dcb-44bd-b06f-5d5772311dbc tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1508 microversion: 2.1 time: 0.243071 Jun 24 15:21:30.295568 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 193/374] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:30 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:30.456155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:30.457106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:30.466488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:30.466943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:30.467753 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:30.468189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:30.646296 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-3d59f975-bc35-48f0-baa6-b4e9721246c3 req-1b853fa3-b0ba-4841-86a8-67a95439a0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a388fa-baf9-475a-9e9e-4b89f267983d", "tag": "f136a5f8-c1cb-48a1-8b07-9b685830d3b5"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:30.662017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3d59f975-bc35-48f0-baa6-b4e9721246c3 req-1b853fa3-b0ba-4841-86a8-67a95439a0a4 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:30.666746 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3d59f975-bc35-48f0-baa6-b4e9721246c3 req-1b853fa3-b0ba-4841-86a8-67a95439a0a4 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:30.685223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-3d59f975-bc35-48f0-baa6-b4e9721246c3 req-1b853fa3-b0ba-4841-86a8-67a95439a0a4 service nova] Creating event network-changed:f136a5f8-c1cb-48a1-8b07-9b685830d3b5 for instance 68a388fa-baf9-475a-9e9e-4b89f267983d on hv-cinder-83538 Jun 24 15:21:30.700497 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-3d59f975-bc35-48f0-baa6-b4e9721246c3 req-1b853fa3-b0ba-4841-86a8-67a95439a0a4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055077 Jun 24 15:21:30.703162 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 194/375] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:21:30.725985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8d57f163-8c0d-4600-9aa2-5fd8df43fe21 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:30.726656 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8d57f163-8c0d-4600-9aa2-5fd8df43fe21 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:30.748338 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d57f163-8c0d-4600-9aa2-5fd8df43fe21 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:30.748816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d57f163-8c0d-4600-9aa2-5fd8df43fe21 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:30.749789 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d57f163-8c0d-4600-9aa2-5fd8df43fe21 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:30.750308 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d57f163-8c0d-4600-9aa2-5fd8df43fe21 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:30.811441 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:30.829121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ae18c600-834e-450a-a05a-248d07fa47ce tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.368720 Jun 24 15:21:30.830729 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 182/376] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:30 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:30.994476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8d57f163-8c0d-4600-9aa2-5fd8df43fe21 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/action" status: 202 len: 0 microversion: 2.20 time: 0.274172 Jun 24 15:21:30.998243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 195/377] 10.222.0.67 () {62 vars in 1318 bytes} [Fri Jun 24 15:21:30 2022] POST /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 15:21:31.003619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:31.004230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:31.011073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:31.011570 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:31.018875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:31.019496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:31.185884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:31.195974 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:31.197464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:31.198891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7340a15f-b0fe-43ee-82de-8cc5d28bf3b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1749 microversion: 2.20 time: 0.199214 Jun 24 15:21:31.199486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 183/378] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:30 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1749 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:31.837513 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:31.838903 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:31.845694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:31.846484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:31.847502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:31.848241 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:32.057596 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:32.065778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6b37783d-3cc5-4e80-b84e-ccc5b3743656 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.232006 Jun 24 15:21:32.066358 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 196/379] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:31 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:32.220490 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:32.221773 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:32.227844 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:32.228299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:32.229071 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:32.229564 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:32.360333 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:32.369557 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:32.371054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:32.372286 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb507636-1204-4e08-9de2-a37c85feff38 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1749 microversion: 2.20 time: 0.156223 Jun 24 15:21:32.372785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 184/380] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:32 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:33.081856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:33.082463 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:33.089183 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:33.089634 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:33.090406 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:33.090846 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:33.227086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:33.234883 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-61559a46-001f-4fa0-88d0-89e7ea4bafd9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.156950 Jun 24 15:21:33.236202 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 197/381] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:33 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:33.390935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:33.391678 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:33.394211 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:33.401907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:33.401907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:33.401907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:33.401907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:33.531687 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:33.540230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:33.542588 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:33.545113 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-93e8e494-2376-452f-9552-f52dab619a73 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1749 microversion: 2.20 time: 0.156697 Jun 24 15:21:33.545737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 185/382] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:33 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:34.254795 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:34.255470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:34.262539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:34.263112 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:34.263934 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:34.264377 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:34.395380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:34.403087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39b6fe94-7fbe-45e5-ad3e-9ffd91cbf37f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.152999 Jun 24 15:21:34.403684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 198/383] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:34 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:34.567143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:34.568295 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:34.575516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:34.575971 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:34.576786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:34.577221 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:34.707891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:34.716220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:34.717727 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:34.718869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7b8ffa05-8ca5-4beb-9675-6aaa09f330e8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1751 microversion: 2.20 time: 0.158391 Jun 24 15:21:34.719469 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 186/384] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:34 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:35.419514 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:35.420156 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:35.422438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:35.429306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:35.429742 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:35.430558 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:35.430997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:35.742295 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:35.742957 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:35.749339 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:35.749791 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:35.750546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:35.751008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:35.754657 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=12 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:35.847674 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:35.856337 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5116d211-a011-466e-a21f-cb42d5770df7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.440629 Jun 24 15:21:35.860850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 199/385] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:35 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:35.907685 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:35.916345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:35.917843 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:35.918991 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-34b5fed0-933d-48c7-9ac2-396463671c5d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1751 microversion: 2.20 time: 0.180764 Jun 24 15:21:35.919576 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 187/386] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:35 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:36.878105 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:36.878697 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:36.885238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:36.885692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:36.886458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:36.886897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:36.941103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:36.942231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:36.948259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:36.948705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:36.949470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:36.949903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:37.066859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:37.075532 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d1c1400a-6924-4e05-9fdf-57ce3ce30421 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.201663 Jun 24 15:21:37.083221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 200/387] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:36 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:37.109603 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:37.118694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:37.120188 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:37.121319 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e5d245db-23c5-4fb6-8421-99e4f0df77b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.184803 Jun 24 15:21:37.125228 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 188/388] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:36 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:38.092220 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:38.092951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:38.095456 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=82 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:38.100726 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:38.101177 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:38.101987 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:38.102548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:38.139755 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:38.140364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:38.147130 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:38.147609 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:38.148576 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:38.149015 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:38.290631 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:38.299037 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5c4e078c-dece-4db4-9f59-2b829ad22203 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.210687 Jun 24 15:21:38.299989 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 201/389] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:38 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:38.322389 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:38.330635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:38.332191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:38.333327 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c5bb8b1b-4a5d-4b2f-9c2b-ec3ec796193a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.197483 Jun 24 15:21:38.333884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 189/390] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:38 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:39.318117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:39.318867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:39.325497 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:39.326154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:39.327154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:39.327617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:39.351307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:39.358670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:39.359881 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:39.362484 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:39.363589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:39.364027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:39.368418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:39.647563 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:39.656833 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a417fe70-d01d-47e1-b9d0-4acd3580597b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.343937 Jun 24 15:21:39.657424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 202/391] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:39 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:39.678715 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:39.687611 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:39.689420 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:39.690652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-89b7c81e-c7f8-4b29-932d-126f235409b8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.343550 Jun 24 15:21:39.692065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 190/392] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:39 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:39.941683 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-96b9a77f-b856-4acf-9feb-46641b1133f5 req-a2eba3c7-8d73-4041-8936-09adae39b115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a388fa-baf9-475a-9e9e-4b89f267983d", "name": "network-vif-plugged", "status": "completed", "tag": "f136a5f8-c1cb-48a1-8b07-9b685830d3b5"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:39.946701 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-96b9a77f-b856-4acf-9feb-46641b1133f5 req-a2eba3c7-8d73-4041-8936-09adae39b115 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:39.947139 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-96b9a77f-b856-4acf-9feb-46641b1133f5 req-a2eba3c7-8d73-4041-8936-09adae39b115 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:39.958257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-96b9a77f-b856-4acf-9feb-46641b1133f5 req-a2eba3c7-8d73-4041-8936-09adae39b115 service nova] Creating event network-vif-plugged:f136a5f8-c1cb-48a1-8b07-9b685830d3b5 for instance 68a388fa-baf9-475a-9e9e-4b89f267983d on hv-cinder-83538 Jun 24 15:21:39.964757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-96b9a77f-b856-4acf-9feb-46641b1133f5 req-a2eba3c7-8d73-4041-8936-09adae39b115 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Jun 24 15:21:39.965853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 203/393] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:21:40.675011 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:40.676955 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:40.686686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:40.686686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:40.687938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:40.688465 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:40.711234 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:40.712595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:40.720038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:40.721307 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:40.723059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:40.724072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:40.955942 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:40.958555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:40.963493 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e3bf17d7-b936-4057-87e2-531f65af77a9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.292834 Jun 24 15:21:40.964046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 191/394] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:40 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:21:40.967081 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:40.968598 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:40.969748 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5b1d3ffc-9849-4401-809a-64a5bb40b54b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.263436 Jun 24 15:21:40.972292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 204/395] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:40 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:41.980060 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:41.980673 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:41.986837 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:41.987321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:41.988942 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:41.989517 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:41.990456 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:41.991138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:41.998554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:41.999283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:42.000414 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:42.000931 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:42.246015 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:42.256552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:42.269107 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:42.270731 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ed770bbb-345f-4a40-8394-82442f111949 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1370 microversion: 2.1 time: 0.295019 Jun 24 15:21:42.271251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:42.271886 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 192/396] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:41 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:42.273126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f11e5bd1-bfa7-42c2-aeb9-094f0c1e8a3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.287702 Jun 24 15:21:42.276570 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 205/397] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:41 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:43.287054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:43.287705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:43.289562 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:43.294915 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:43.299280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:43.299280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:43.299280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:43.304829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:43.314921 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:43.322330 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:43.322766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:43.323561 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:43.323991 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:43.517521 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:43.526239 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:43.528407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-326c6c02-2d22-4440-beb0-b7730be7a46f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1564 microversion: 2.1 time: 0.244215 Jun 24 15:21:43.535582 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 193/398] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:21:43 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1564 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:21:43.548117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:43.552481 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:43.553821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-70dc28ba-1187-4bf4-a4c7-55add295fffe tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.260529 Jun 24 15:21:43.554419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c42b9231-3ab8-4fff-9f79-1ea961ab3c38 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:43.554875 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 206/399] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:43 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:21:43.555486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c42b9231-3ab8-4fff-9f79-1ea961ab3c38 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:43.564981 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c42b9231-3ab8-4fff-9f79-1ea961ab3c38 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:43.566318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c42b9231-3ab8-4fff-9f79-1ea961ab3c38 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:43.571355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c42b9231-3ab8-4fff-9f79-1ea961ab3c38 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:43.571979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c42b9231-3ab8-4fff-9f79-1ea961ab3c38 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:43.670630 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c42b9231-3ab8-4fff-9f79-1ea961ab3c38 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122255 Jun 24 15:21:43.671236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 194/400] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:21:43 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:21:44.577202 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:44.578992 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:44.590539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:44.590981 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:44.591798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:44.592224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:44.741848 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:44.753018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:44.760174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:44.760174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a2e457e4-34cc-4b7c-9515-4a07feca5db8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.184541 Jun 24 15:21:44.760174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 207/401] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:44 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:45.526043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-b3195334-83dd-409c-bd44-f4a656b79bdb req-952d24b4-85c6-4098-bf64-99df697383f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a388fa-baf9-475a-9e9e-4b89f267983d", "tag": "f136a5f8-c1cb-48a1-8b07-9b685830d3b5"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:21:45.543206 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b3195334-83dd-409c-bd44-f4a656b79bdb req-952d24b4-85c6-4098-bf64-99df697383f4 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:45.543697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b3195334-83dd-409c-bd44-f4a656b79bdb req-952d24b4-85c6-4098-bf64-99df697383f4 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:45.559122 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-b3195334-83dd-409c-bd44-f4a656b79bdb req-952d24b4-85c6-4098-bf64-99df697383f4 service nova] Creating event network-changed:f136a5f8-c1cb-48a1-8b07-9b685830d3b5 for instance 68a388fa-baf9-475a-9e9e-4b89f267983d on hv-cinder-83538 Jun 24 15:21:45.565853 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-b3195334-83dd-409c-bd44-f4a656b79bdb req-952d24b4-85c6-4098-bf64-99df697383f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043672 Jun 24 15:21:45.567794 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 195/402] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:21:45.776743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:45.777705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:45.785977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:45.786428 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:45.787231 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:45.787831 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:45.805802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:45.950077 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:45.960951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:45.962453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:45.963691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d829c142-c710-44ec-8e6a-20ae386e9f1e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.191358 Jun 24 15:21:45.965908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 208/403] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:45 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:46.988504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:46.990710 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:46.998161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:46.998962 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:46.999848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:47.000342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:47.285846 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:47.296355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:47.300903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:47.302197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ebf434a0-614a-43ba-afe7-be55540967cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.319223 Jun 24 15:21:47.302760 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 196/404] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:46 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:48.322009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:48.322621 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:48.330215 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:48.330886 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:48.331881 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:48.332550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:48.866845 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:48.875817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:48.877302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:48.879666 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7ce880ba-6378-4f31-85cf-7ce49a665978 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.562608 Jun 24 15:21:48.881032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 209/405] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:48 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:49.906252 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:49.923273 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:49.926037 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:49.927270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:49.928823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:49.929452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:50.151937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:50.167830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:50.170133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:50.171891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bc13765a-e4b7-4883-9072-57a4efe5c60b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.271982 Jun 24 15:21:50.173317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 197/406] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:49 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:51.191777 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:51.193065 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:51.209534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:51.209989 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:51.213734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:51.213734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:51.600426 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:51.612900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:51.614876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:51.616891 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d84893fc-fdd9-43f6-8560-45127063dd79 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.430236 Jun 24 15:21:51.619082 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 210/407] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:51 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:52.636801 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:52.647964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:52.647964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:52.647964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:52.647964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:52.655907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:53.138151 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:53.155292 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:53.160976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:53.169701 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0e2c4bb1-21ca-4424-bf5c-21ac8d794fd4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.537719 Jun 24 15:21:53.172336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 198/408] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:52 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:54.190007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:54.191765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:54.207896 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:54.208448 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:54.209135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:54.209570 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:54.574772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:54.590595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:54.592921 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:54.595746 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f99a1f94-4668-4222-9434-c772a996a308 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.409703 Jun 24 15:21:54.600486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 211/409] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:54 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:55.617630 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:55.620184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:55.642361 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:55.644656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:55.646901 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:55.646901 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:56.017100 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:56.034840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:56.037675 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:56.039070 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7ba8858-7d49-4c2b-957c-3280c1ed274e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.425667 Jun 24 15:21:56.040119 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 199/410] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:55 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:57.058422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:57.059745 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:57.069732 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:57.070484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:57.072026 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:57.072650 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:57.401013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:57.427518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:57.429226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:57.430466 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-88182b49-66c3-4786-b298-2d9d392b13b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.376343 Jun 24 15:21:57.431042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 212/411] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:57 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:58.450886 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:58.453717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:58.463442 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:58.463907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:58.464698 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:58.465141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:58.710069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:58.720716 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:58.722911 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:21:58.724283 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-26be2490-146b-4568-b9fb-3ea2e0f7d643 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.279966 Jun 24 15:21:58.725431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 200/412] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:58 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:21:59.765528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:21:59.766996 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:21:59.775466 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:59.776138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:21:59.777644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:21:59.778276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:00.070705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:00.083009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:00.085599 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:00.088966 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e1ea0c7-41ed-42c1-86f6-6ba0f90beb8e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.349526 Jun 24 15:22:00.090649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 213/413] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:21:59 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:00.294994 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-73d39f15-dc5e-41e7-9411-9473b42863f6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4647410e-e257-4ed8-b205-a86c6130b04f", "device": "/dev/sdb"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:00.296592 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-73d39f15-dc5e-41e7-9411-9473b42863f6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:00.303948 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73d39f15-dc5e-41e7-9411-9473b42863f6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:00.304401 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73d39f15-dc5e-41e7-9411-9473b42863f6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:00.305178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73d39f15-dc5e-41e7-9411-9473b42863f6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:00.305613 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-73d39f15-dc5e-41e7-9411-9473b42863f6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:00.715004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1558799589", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1293239622", "security_groups": [{"name": "tempest-secgroup-smoke-141842094"}], "networks": [{"uuid": "6c164619-5a9e-49c6-b97b-50e7f7499706"}], "block_device_mapping_v2": [{"uuid": "19b7fbcc-9fba-453e-8acc-91bde4f5332a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:00.944232 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] validate_networks() for [('6c164619-5a9e-49c6-b97b-50e7f7499706', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:22:01.452567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:22:01.453614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:22:01.455853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:22:01.456790 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:22:01.457380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:22:01.470293 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:01.475333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:01.475333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:01.475333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:01.499794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Getting quotas for project 66edbd777b48472b8fcd5a3f43c68dcc. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:22:01.506555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Getting quotas for user bb55f38fa3c741cbb7f00e310368a85b and project 66edbd777b48472b8fcd5a3f43c68dcc. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:22:01.599634 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:22:01.601764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19b7fbcc-9fba-453e-8acc-91bde4f5332a',volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:22:02.688896 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f37217e0-dfc7-4e32-9b81-d6f6b9296709 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.977902 Jun 24 15:22:02.696086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 214/414] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:22:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 15:22:02.702967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:02.703881 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:02.716913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:02.717666 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:02.718731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:02.719398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:02.979738 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:02.990360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:02.992135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:02.993582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8cd60716-f5b8-466f-ab12-02399837a68a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.296240 Jun 24 15:22:02.994330 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 215/415] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:02 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:02.999838 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06915816-57a9-40ad-bcac-23d586c16b82 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:03.000673 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-06915816-57a9-40ad-bcac-23d586c16b82 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:03.083756 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-06915816-57a9-40ad-bcac-23d586c16b82 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:03.093995 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-06915816-57a9-40ad-bcac-23d586c16b82 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1089 microversion: 2.1 time: 0.096274 Jun 24 15:22:03.095282 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 216/416] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:02 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:03.103165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-73d39f15-dc5e-41e7-9411-9473b42863f6 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "POST /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.811817 Jun 24 15:22:03.107545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 201/417] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:22:00 2022] POST /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904/os-volume_attachments => generated 194 bytes in 2814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:04.015531 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:04.016736 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:04.036293 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:04.040070 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:04.040070 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:04.041042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:04.113779 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f818fa40-eb9e-4f6e-a3fa-d0a74ff183ae tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:04.114480 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f818fa40-eb9e-4f6e-a3fa-d0a74ff183ae tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:04.208200 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f818fa40-eb9e-4f6e-a3fa-d0a74ff183ae tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:04.216050 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f818fa40-eb9e-4f6e-a3fa-d0a74ff183ae tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1089 microversion: 2.1 time: 0.107515 Jun 24 15:22:04.233910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 202/418] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:04 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1089 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:04.339574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:04.357024 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:04.365082 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:04.366382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a9d663b-1652-4f03-b416-0a28c918f81f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.357719 Jun 24 15:22:04.367525 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 217/419] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:04 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:05.251043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:05.251979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:05.260737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:05.261337 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:05.262246 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:05.262847 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:05.330690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:05.339068 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d4d2266e-1e9f-4873-a957-54cd0b2b3282 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1187 microversion: 2.1 time: 0.092403 Jun 24 15:22:05.347629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 203/420] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:05 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:05.384204 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:05.385051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:05.391623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:05.392206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:05.393088 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:05.393645 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:05.528634 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:05.537713 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:05.539232 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:05.540373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4c375dfe-7285-4961-88a6-2b178157fa7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.160419 Jun 24 15:22:05.540973 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 218/421] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:05 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:22:06.358090 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:06.358756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:06.371332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:06.372121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:06.373123 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:06.373752 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:06.474081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:06.484514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0a7d4040-172d-4742-9db6-3c4461ba136d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1205 microversion: 2.1 time: 0.131094 Jun 24 15:22:06.485087 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 204/422] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:06 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1205 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:06.562182 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:06.562848 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:06.572217 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:06.573026 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:06.574021 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:06.574868 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:07.032498 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:07.042276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:07.044386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:07.045774 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9a5aa8e3-462f-47dc-a087-069c03c32dd9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.490068 Jun 24 15:22:07.046574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 219/423] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:06 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:07.504141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:07.504844 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:07.522334 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:07.522780 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:07.524056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:07.524714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:07.763711 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:07.772840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b7d25a58-5e24-4db6-87d5-42eb3298110d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1272 microversion: 2.1 time: 0.273569 Jun 24 15:22:07.783381 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 205/424] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:07 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:08.070038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:08.070968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:08.081437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:08.082187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:08.083059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:08.083669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:08.309343 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:08.322460 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:08.327974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:08.330455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9d18a54e-2188-48d3-b079-1147fde205eb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.269631 Jun 24 15:22:08.343119 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 220/425] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:08 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:08.527863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-534d9328-57ab-431b-9ffd-abcb3c94d6e2 req-09fcea70-7300-490f-aa21-1d64c16a256c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa864c2-63a6-4aa7-8ea6-3ce12daff080", "tag": "e9c0e7f6-a572-47c4-8390-be9bdb776041"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:08.541481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-534d9328-57ab-431b-9ffd-abcb3c94d6e2 req-09fcea70-7300-490f-aa21-1d64c16a256c service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:08.541930 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-534d9328-57ab-431b-9ffd-abcb3c94d6e2 req-09fcea70-7300-490f-aa21-1d64c16a256c service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:08.557227 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-534d9328-57ab-431b-9ffd-abcb3c94d6e2 req-09fcea70-7300-490f-aa21-1d64c16a256c service nova] Creating event network-changed:e9c0e7f6-a572-47c4-8390-be9bdb776041 for instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 on hv-cinder-83538 Jun 24 15:22:08.566993 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-534d9328-57ab-431b-9ffd-abcb3c94d6e2 req-09fcea70-7300-490f-aa21-1d64c16a256c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043090 Jun 24 15:22:08.568243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 206/426] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:08.791915 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:08.792666 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:08.795741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:08.801780 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:08.802239 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:08.803023 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:08.803516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:09.006295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:09.013785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-100ea49e-5393-4b92-92e0-7132467bf924 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1272 microversion: 2.1 time: 0.226604 Jun 24 15:22:09.014362 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 221/427] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:08 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:09.350873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:09.351705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:09.358439 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:09.358899 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:09.359802 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:09.360242 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:09.526587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:09.538798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:09.541901 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:09.543080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c1a35d49-92b9-4134-85b1-435c6a11bb7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.196992 Jun 24 15:22:09.543690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 207/428] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:09 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:10.035523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:10.035523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:10.042115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:10.042946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:10.044017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:10.044677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:10.342317 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:10.352471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-edee14b3-127b-4e2b-82bd-107cb27f26b1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1272 microversion: 2.1 time: 0.325323 Jun 24 15:22:10.353418 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 222/429] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:10 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1272 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:10.564144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:10.566073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:10.582575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:10.583084 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:10.584642 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:10.585087 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:10.588700 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:10.820337 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:10.843892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:10.848155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:10.851048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2ff8a2e8-ae4e-4dab-bee2-829eebb8d3b1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.291752 Jun 24 15:22:10.852251 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 208/430] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:10 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:11.370484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:11.371052 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:11.378472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:11.380690 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:11.381718 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:11.387564 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:11.485092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:11.618566 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:11.630946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f656b9eb-fa68-42d6-80e6-a6d24111473a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1272 microversion: 2.1 time: 0.264532 Jun 24 15:22:11.632355 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 223/431] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:11 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:11.870163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:11.870730 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:11.885027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:11.885505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:11.886285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:11.886729 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:12.081252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-96ef9f83-e523-4efe-81e5-b6d0710d9f66 req-e6d71fac-5ea1-4301-a9ec-1aa8ac764194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24b4aae-8cee-48cc-bf18-e9a915ea3f2c", "name": "network-vif-plugged", "status": "completed", "tag": "5f0c5043-24b7-4a39-9766-66475f0cad69"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:12.099445 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-96ef9f83-e523-4efe-81e5-b6d0710d9f66 req-e6d71fac-5ea1-4301-a9ec-1aa8ac764194 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:12.100137 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-96ef9f83-e523-4efe-81e5-b6d0710d9f66 req-e6d71fac-5ea1-4301-a9ec-1aa8ac764194 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:12.118861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-96ef9f83-e523-4efe-81e5-b6d0710d9f66 req-e6d71fac-5ea1-4301-a9ec-1aa8ac764194 service nova] Creating event network-vif-plugged:5f0c5043-24b7-4a39-9766-66475f0cad69 for instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c on hv-cinder-83538 Jun 24 15:22:12.126868 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-96ef9f83-e523-4efe-81e5-b6d0710d9f66 req-e6d71fac-5ea1-4301-a9ec-1aa8ac764194 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049960 Jun 24 15:22:12.127986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 224/432] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:22:12.152848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:12.154609 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:12.156303 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:12.157670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8a25206c-e234-4062-9cd9-d6c9fa731ac6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.291709 Jun 24 15:22:12.158262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 209/433] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:11 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:12.652715 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:12.653472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:12.660240 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:12.660685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:12.661483 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:12.662206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:12.838462 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:12.847318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-df53ef8a-9c91-45e3-a36d-5ebcb0a6afe9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.203219 Jun 24 15:22:12.847940 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 225/434] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:12 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:13.179566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:13.179965 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:13.186677 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:13.187257 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:13.188071 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:13.188449 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:13.338246 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:13.352205 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:13.354583 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:13.360298 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ebd204e-5fb1-49cd-aa2e-11065f5d847e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.185626 Jun 24 15:22:13.373228 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 210/435] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:13 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:13.864926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:13.865624 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:13.867694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=8 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:13.873358 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:13.873918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:13.874812 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:13.875405 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:14.011029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:14.019496 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5664b6d5-09c9-43b1-b08a-6ace6ec473e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.158708 Jun 24 15:22:14.020398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 226/436] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:13 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:14.076326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8d36f44-e8a1-4f1b-bb16-ae4c2a0e833a tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Action: 'create', calling method: .version_select at 0x7f18b2191550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-961804416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9O3L+93yuT4efl0gkMQUFdmIVrD/VdzA4+kzJtKw8+4ZmyyeKw6DsepKa/nSt4O3Hvp6RuDordcyn9RCZzmYESMIrQryofcL6F/2yKlV5/gWmkskYCHkBBGebBc4y+JQ=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:14.080318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=38 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:14.092536 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-f8d36f44-e8a1-4f1b-bb16-ae4c2a0e833a tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Getting quotas for project fb2390854b0345588bd6b68f5c09a1ee. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:22:14.097193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-f8d36f44-e8a1-4f1b-bb16-ae4c2a0e833a tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Getting quotas for user e4f136ae627b4a81b6b29c667420f1aa and project fb2390854b0345588bd6b68f5c09a1ee. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:22:14.299966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8d36f44-e8a1-4f1b-bb16-ae4c2a0e833a tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.226847 Jun 24 15:22:14.300605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 211/437] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:22:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:14.379479 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:14.380085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:14.387605 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:14.388197 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:14.389395 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:14.389903 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:14.395913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:14.409338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1027716054", "imageRef": "79a44ef2-b92e-42a9-9913-7bd59341a96a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-961804416", "networks": [{"uuid": "6f212514-c323-4661-9a70-8b24c5462bcd"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:14.469797 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] validate_networks() for [('6f212514-c323-4661-9a70-8b24c5462bcd', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:22:14.597005 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:14.605507 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:14.607004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:14.608221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2d73d73e-2c04-4ce4-b312-6b2dba1f9860 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.232749 Jun 24 15:22:14.608964 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 227/438] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:14 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:14.876804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:22:14.879074 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:22:14.879074 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:22:14.879074 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:22:14.879372 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:22:14.888182 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:14.888700 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:14.889559 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:14.890054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:14.908291 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Getting quotas for project fb2390854b0345588bd6b68f5c09a1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:22:14.912499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Getting quotas for user e4f136ae627b4a81b6b29c667420f1aa and project fb2390854b0345588bd6b68f5c09a1ee. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:22:14.923255 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:22:14.926850 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79a44ef2-b92e-42a9-9913-7bd59341a96a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:22:15.039067 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:15.039714 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:15.046273 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:15.046726 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:15.047534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:15.047971 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:15.063263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-216c26ec-4f4a-4a3e-91a3-832e7196be04 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659268 Jun 24 15:22:15.064075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 212/439] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 15:22:15.074997 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a81513dd-1614-4583-bb04-a20fbfc948e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:15.076042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a81513dd-1614-4583-bb04-a20fbfc948e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:15.166917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a81513dd-1614-4583-bb04-a20fbfc948e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:15.176292 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a81513dd-1614-4583-bb04-a20fbfc948e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1258 microversion: 2.1 time: 0.105038 Jun 24 15:22:15.177200 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 213/440] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:15 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1258 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:15.282978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:15.292999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-38538003-c265-4227-a194-c932c056e2b8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.257766 Jun 24 15:22:15.302729 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 228/441] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:15 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:15.626757 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:15.628007 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:15.634357 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:15.635069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:15.636075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:15.636509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:15.776155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:15.785141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:15.786643 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:15.787835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9961f54a-75b2-4493-8097-e6dbbc6ff437 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.165472 Jun 24 15:22:15.788396 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 214/442] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:15 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:16.193993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-149ebf05-db4a-4d53-801a-958a228754de tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:16.194595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-149ebf05-db4a-4d53-801a-958a228754de tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:16.248287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-149ebf05-db4a-4d53-801a-958a228754de tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:16.255678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-149ebf05-db4a-4d53-801a-958a228754de tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1258 microversion: 2.1 time: 0.065838 Jun 24 15:22:16.256239 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 229/443] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:16 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:16.309810 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:16.310352 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:16.317494 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:16.317946 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:16.318713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:16.319158 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:16.453656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:16.461191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-396a59c3-06c6-43da-96af-ffcfdd5c9405 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.155344 Jun 24 15:22:16.461757 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 215/444] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:16 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:16.805988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:16.806592 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:16.812811 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:16.813267 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:16.814033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:16.814474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:16.949332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:16.958397 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:16.959910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:16.961077 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e83e737a-a933-41ae-a9e0-f8f12696447f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.159039 Jun 24 15:22:16.961640 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 230/445] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:16 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:17.272506 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:17.273107 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:17.279804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:17.280246 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:17.280997 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:17.281425 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:17.341127 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:17.349045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-92e63700-b6f0-41fc-b75d-5fc64ec3dda5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1262 microversion: 2.1 time: 0.080307 Jun 24 15:22:17.349546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 216/446] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:17 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:17.477624 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:17.478220 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:17.484682 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:17.485119 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:17.485867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:17.486294 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:17.631924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:17.639263 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3e0f5ebf-de04-493a-a794-631ab8cb182f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.165361 Jun 24 15:22:17.639824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 231/447] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:17 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:17.980089 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:17.980726 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:17.987103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:17.987570 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:17.988322 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:17.988751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:18.117392 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:18.125532 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:18.127015 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:18.128722 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b67cf4d8-fbc0-4de7-a370-4f365994ebba tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.152552 Jun 24 15:22:18.129272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 217/448] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:17 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:18.366875 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:18.367474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:18.373552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:18.373999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:18.374760 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:18.375218 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:18.435271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:18.442593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2403c3b4-2a95-4e40-baf1-5bf3ffae7a86 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1262 microversion: 2.1 time: 0.079744 Jun 24 15:22:18.443148 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 232/449] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:18 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:18.655754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:18.656371 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:18.663784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:18.664235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:18.664999 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:18.665434 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:18.795548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:18.803813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5ed81d55-6c31-4532-9fef-5e6f1b1b38bc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.152158 Jun 24 15:22:18.804378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 218/450] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:18 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:19.146963 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:19.147582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:19.154405 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:19.154849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:19.155634 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:19.156061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:19.284564 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:19.293980 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:19.294473 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:19.295638 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a35473e4-2b9d-4116-aa3d-6a4dd420b77a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.152583 Jun 24 15:22:19.296194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 233/451] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:19 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:19.459147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:19.459785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:19.465766 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:19.466215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:19.466976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:19.467447 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:19.527734 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:19.535112 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-28ba6f09-38d3-4b60-8e45-684db47dc20f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1262 microversion: 2.1 time: 0.079885 Jun 24 15:22:19.535897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 219/452] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:19 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:19.820405 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:19.821036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:19.827026 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:19.831512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:19.831512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:19.831512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:19.962153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:19.969559 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6741dc07-6510-49a2-8d52-6a6799412fd8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.152992 Jun 24 15:22:19.970115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 234/453] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:19 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:20.314106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:20.315038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:20.321819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:20.322266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:20.323031 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:20.323504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:20.457643 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:20.466226 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:20.467759 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:20.468977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c9631f78-3247-44b5-a0ae-5984bb4dc17b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.159021 Jun 24 15:22:20.470933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 220/454] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:20 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:22:20.552840 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:20.553457 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:20.560107 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:20.560567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:20.561341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:20.561779 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:20.625085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:20.633168 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a46912ff-9c33-4ecb-996f-9b2f4ef224e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1310 microversion: 2.1 time: 0.084924 Jun 24 15:22:20.633651 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 235/455] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:20 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:20.987264 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:20.987835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:20.993815 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:20.994256 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:20.995002 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:20.995466 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:21.131140 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:21.138963 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ac1754b9-06ca-464d-8c00-b41243a85769 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.156019 Jun 24 15:22:21.139562 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 221/456] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:20 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:21.486756 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:21.487529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:21.493499 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:21.493890 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:21.494643 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:21.495079 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:21.626392 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:21.634901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:21.636459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:21.637591 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cc0b736e-b4af-4a46-822a-3dbbf5214586 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.154971 Jun 24 15:22:21.638144 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 236/457] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:21 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:21.651764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:21.652652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:21.659951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:21.662161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:21.662161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:21.662161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:21.722076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:21.729992 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-215ad083-fd32-4439-b14d-ca4d22ebaed8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1310 microversion: 2.1 time: 0.081959 Jun 24 15:22:21.730551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 222/458] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:21 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:22.155941 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:22.156552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:22.163284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:22.163734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:22.164579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:22.165013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:22.299984 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:22.307438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eaa7a05e-a466-4bf8-818b-f29d8cf9d136 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.155881 Jun 24 15:22:22.308001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 237/459] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:22 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:22.657018 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:22.657620 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:22.664898 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:22.665345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:22.666098 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:22.666523 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:22.747229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:22.749582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:22.756687 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:22.757220 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:22.758049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:22.758480 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:22.806535 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:22.815246 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:22.816756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:22.817969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ffa72d8d-8eb2-4165-b552-b27728f6b0a0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.164702 Jun 24 15:22:22.818466 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 223/460] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:22 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:22.821916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:22.829452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fecc6281-90c7-472c-a03f-97cbfb4cff7c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1310 microversion: 2.1 time: 0.086037 Jun 24 15:22:22.830036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 238/461] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:22 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:23.324443 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:23.325043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:23.330992 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:23.331461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:23.332211 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:23.332648 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:23.463063 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:23.470503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-90bc8c38-c482-462d-80b2-f1c8d3b66bb3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.149903 Jun 24 15:22:23.471731 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 224/462] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:23 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:23.836213 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:23.836816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:23.843351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:23.843801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:23.844564 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:23.844998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:23.846165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:23.846819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:23.853213 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:23.853662 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:23.854421 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:23.854845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:23.935738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:23.944457 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-db799f2a-c7ff-4bd0-a0fa-689fc87be52e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1310 microversion: 2.1 time: 0.102250 Jun 24 15:22:23.945367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 225/463] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:23 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:24.007779 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:24.016283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:24.017859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:24.019115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2c0c802b-dfd4-4447-aa67-968fa969c238 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1807 microversion: 2.20 time: 0.186842 Jun 24 15:22:24.019702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 239/464] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:23 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:22:24.487887 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:24.488415 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:24.494710 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:24.495307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:24.496076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:24.496594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:24.712771 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:24.718730 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d87e92d8-7390-45e6-8112-d8528812c24c tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.234961 Jun 24 15:22:24.719312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 226/465] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:24 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:24.962011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:24.962648 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:24.969295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:24.969749 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:24.970511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:24.971607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:25.039368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:25.039856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:25.040243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:25.044396 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:25.058537 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2b8b0c05-b056-46ad-a9d2-3b5dadccd957 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1328 microversion: 2.1 time: 0.089916 Jun 24 15:22:25.058709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:25.058836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 240/466] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:24 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:25.059374 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:25.060399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:25.060850 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:25.076747 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:25.173098 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=14 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:25.267251 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:25.277283 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:25.278906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:25.280039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6c1677e7-6aee-41a4-a02f-24e71e2717db tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1794 microversion: 2.20 time: 0.245084 Jun 24 15:22:25.280959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 227/467] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:22:25 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1794 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:22:25.738023 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:25.738741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:25.749262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:25.749807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:25.750663 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:25.751378 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:25.973017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:25.991797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ed4d4ec0-6729-4b00-922d-8ae603588d53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.255001 Jun 24 15:22:25.992554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 241/468] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:25 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:26.068919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:26.069522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:26.076753 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:26.077481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:26.078484 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:26.079137 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:26.515101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:26.522895 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6d943b46-7cd9-42bb-885e-59c640501895 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.460197 Jun 24 15:22:26.524160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 228/469] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:26 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:27.010602 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:27.011312 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:27.013077 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:27.019007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:27.019887 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:27.021040 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:27.021472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:27.167018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:27.175756 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-04766d7b-e49f-4950-aee4-c864ed0a6434 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.170220 Jun 24 15:22:27.176647 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 242/470] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:27 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:27.542155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:27.542765 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:27.549949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:27.550432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:27.551280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:27.551717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:27.718490 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:27.727065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-96857158-705f-4ca5-81a1-344a0e028f0c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.189061 Jun 24 15:22:27.727806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 229/471] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:27 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:28.182319 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-5347e9ce-67f1-40bf-bfbe-4923d46f56f8 req-dd46d71f-e5e0-49ba-856c-2a219b3e0a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa864c2-63a6-4aa7-8ea6-3ce12daff080", "name": "network-vif-plugged", "status": "completed", "tag": "e9c0e7f6-a572-47c4-8390-be9bdb776041"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:28.199434 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:28.200458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5347e9ce-67f1-40bf-bfbe-4923d46f56f8 req-dd46d71f-e5e0-49ba-856c-2a219b3e0a61 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:28.200918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5347e9ce-67f1-40bf-bfbe-4923d46f56f8 req-dd46d71f-e5e0-49ba-856c-2a219b3e0a61 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:28.201368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:28.208834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:28.216152 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:28.216152 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:28.216152 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:28.216567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-5347e9ce-67f1-40bf-bfbe-4923d46f56f8 req-dd46d71f-e5e0-49ba-856c-2a219b3e0a61 service nova] Creating event network-vif-plugged:e9c0e7f6-a572-47c4-8390-be9bdb776041 for instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 on hv-cinder-83538 Jun 24 15:22:28.219555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-5347e9ce-67f1-40bf-bfbe-4923d46f56f8 req-dd46d71f-e5e0-49ba-856c-2a219b3e0a61 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041097 Jun 24 15:22:28.220194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 243/472] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:28.229089 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:28.229751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:28.238403 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:28.238866 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:28.239839 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:28.240342 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:28.428188 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:28.442856 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4b1f7449-3066-4dd2-9603-cbc803de0d58 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.254090 Jun 24 15:22:28.443539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 230/473] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:28 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:28.445853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lazy-loading 'services' on Instance uuid 73badc72-7d3b-46a6-937c-aad405645904 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:22:28.640769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:28.740452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a2bbcca5-89ff-42a8-b8bf-cc6f674d0fe5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "DELETE /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904/os-volume_attachments/4647410e-e257-4ed8-b205-a86c6130b04f" status: 202 len: 0 microversion: 2.1 time: 0.515389 Jun 24 15:22:28.741118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 244/474] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:22:28 2022] DELETE /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904/os-volume_attachments/4647410e-e257-4ed8-b205-a86c6130b04f => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:22:28.747560 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:28.748754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:28.756033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:28.756497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:28.757278 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:28.757715 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:28.915416 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:28.923507 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6d1d22ac-ebbf-4620-af7b-1d0211ff5f7f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.182151 Jun 24 15:22:28.933293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 231/475] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:28 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:29.460770 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:29.461664 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:29.468128 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:29.468583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:29.469362 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:29.469802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:29.609978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:29.618980 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3760b0e7-b5df-4401-a495-97f3d9c88276 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.162924 Jun 24 15:22:29.629307 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 245/476] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:29 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:29.942183 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:29.943015 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:29.949677 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:29.950126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:29.950907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:29.951382 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:30.095056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:30.104473 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c258d1f8-f942-44a0-b903-8d3d27df1986 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.167149 Jun 24 15:22:30.105263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 232/477] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:29 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:30.637262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:30.638037 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:30.645348 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:30.645798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:30.646565 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:30.646994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:30.785582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:30.793048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-998a7f95-6ec4-4f92-9ba1-f0ef1f6bac13 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.159775 Jun 24 15:22:30.793843 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 246/478] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:30 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:31.122262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:31.123066 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:31.129484 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:31.129987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:31.130751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:31.131205 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:31.270524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:31.278215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eea3b051-cbf1-413d-b478-cec5d9d621c1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.159914 Jun 24 15:22:31.278978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 233/479] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:31 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:31.810402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:31.811081 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:31.818078 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:31.818517 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:31.819316 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:31.819751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:31.969886 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:31.978396 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8d755566-c83d-4cb0-b787-bfc2cdedc456 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.172281 Jun 24 15:22:31.978978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 247/480] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:31 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:32.295200 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:32.295736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:32.303061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:32.303555 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:32.304335 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:32.304771 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:32.462305 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:32.470088 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e4f03f9e-7b3f-4900-bfd7-9313303d37f5 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.178819 Jun 24 15:22:32.471522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 234/481] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:32 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:32.995542 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:32.996422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:33.004393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:33.004836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:33.005751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:33.006265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:33.160158 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:33.167018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e880f87-8b2d-451d-99be-b4ee1ea811e4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.175568 Jun 24 15:22:33.167629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 248/482] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:32 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:33.488283 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:33.489050 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:33.495690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:33.496132 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:33.496891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:33.497321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:33.630542 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:33.638093 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d1a0a8b2-de69-4afc-afbc-4ebcbfe976c4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.154191 Jun 24 15:22:33.638657 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 235/483] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:33 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:34.184057 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:34.184667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:34.191488 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:34.193210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:34.193210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:34.194129 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:34.401802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:34.418807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ce581aa-8d13-4fc8-8285-1eec984de945 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.238486 Jun 24 15:22:34.419749 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 249/484] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:34 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:34.655890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:34.656679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:34.666253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:34.666253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:34.666253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:34.666253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:34.680498 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-7ef5ef50-89b3-430f-92fa-5ca336e4f09f req-0015f369-1c31-4e36-a44b-c662719e51bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b13f6b-a027-4371-8012-54f025a726fa", "tag": "18c7a045-91ca-44b2-abe0-c90523b83549"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:34.703135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7ef5ef50-89b3-430f-92fa-5ca336e4f09f req-0015f369-1c31-4e36-a44b-c662719e51bb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:34.703135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-7ef5ef50-89b3-430f-92fa-5ca336e4f09f req-0015f369-1c31-4e36-a44b-c662719e51bb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:34.710877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-7ef5ef50-89b3-430f-92fa-5ca336e4f09f req-0015f369-1c31-4e36-a44b-c662719e51bb service nova] Creating event network-changed:18c7a045-91ca-44b2-abe0-c90523b83549 for instance 79b13f6b-a027-4371-8012-54f025a726fa on hv-cinder-83538 Jun 24 15:22:34.716011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-7ef5ef50-89b3-430f-92fa-5ca336e4f09f req-0015f369-1c31-4e36-a44b-c662719e51bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041045 Jun 24 15:22:34.716609 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 250/485] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:34.821952 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:34.834540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-94d1b10a-b4ab-4a16-b57a-2e04bdf3989c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.182833 Jun 24 15:22:34.843374 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 236/486] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:34 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:35.203724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:35.204304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:35.211166 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.211680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.212446 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.212880 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.237994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:22:35.436084 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:35.436691 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:35.442779 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.443269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.444059 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.444503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.494153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d1758421-2ef6-410d-87fd-dd58aeaf53a1 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "DELETE /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 204 len: 0 microversion: 2.1 time: 0.294746 Jun 24 15:22:35.494851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 251/487] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:22:35 2022] DELETE /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 15:22:35.504135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:35.505069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:35.510966 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.511454 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.512260 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.512699 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.651411 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:35.661534 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2c1a79c4-21b1-4463-ba9f-062652fc3bbd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.229192 Jun 24 15:22:35.662802 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 237/488] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:35 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:35.741907 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:35.749690 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-216fbec7-2ddc-4187-b8ae-b63b50065cee tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1514 microversion: 2.1 time: 0.250570 Jun 24 15:22:35.750279 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 252/489] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:35 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:35.857793 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:35.858360 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:35.865322 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.865767 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.866524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:35.866959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:35.997340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:36.005753 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-885d14de-81dc-4c3d-ab3d-7eff789c1f0b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.151866 Jun 24 15:22:36.006320 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 238/490] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:35 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:36.678557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:36.679171 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:36.685810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:36.686267 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:36.687029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:36.687501 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:36.767636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:36.768320 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:36.774494 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:36.774947 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:36.775738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:36.776175 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:36.826299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:36.833861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0671e152-a791-4a85-a592-468e69db5ceb tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1260 microversion: 2.1 time: 0.159178 Jun 24 15:22:36.834432 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 253/491] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:36 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:36.911614 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:36.918915 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ce80909-0ada-47ae-beec-2b4631ada317 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1514 microversion: 2.1 time: 0.155255 Jun 24 15:22:36.919503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 239/492] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:36 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:37.022414 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:37.022947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:37.029136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:37.029581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:37.030336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:37.030770 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:37.160789 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:37.168248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-164bb268-c33b-4443-b14c-a80dc28ce47e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.149779 Jun 24 15:22:37.168812 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 254/493] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:37 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:37.850296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:37.850951 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:37.856926 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:37.857377 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:37.858139 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:37.858576 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:37.936414 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:37.937018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:38.011372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:38.011372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:38.011372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:38.011372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:38.011847 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:38.013317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ec5c3078-cce3-4b38-b642-4587e0eb48c5 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1443 microversion: 2.1 time: 0.166836 Jun 24 15:22:38.014256 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 240/494] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:37 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1443 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:38.035083 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:38.035836 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:38.042647 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:38.043217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:38.044182 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:38.044693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:38.133785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:38.143877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3370d2bc-fa9e-4f2b-a7ae-23bd98804412 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1514 microversion: 2.1 time: 0.208755 Jun 24 15:22:38.143877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 255/495] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:37 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:38.186413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:38.187165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:38.194020 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:38.194467 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:38.195285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:38.195752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:38.198605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:38.206783 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bedb54b9-9043-4033-8e96-fd6601d36f26 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1443 microversion: 2.1 time: 0.177127 Jun 24 15:22:38.207376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 241/496] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:38 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:38.341876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:38.350035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cf74062e-b29c-426d-b6d3-28c0dc6d116b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.168095 Jun 24 15:22:38.350793 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 256/497] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:38 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:39.011380 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-5f7ba5ac-ec38-48b8-afa6-80baa37dc156 req-fe435b11-02b5-4c07-832e-02820e0252ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73badc72-7d3b-46a6-937c-aad405645904", "name": "network-vif-deleted", "tag": "da0887a0-7787-4561-9520-968f8cd45bcf"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:39.021449 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-5f7ba5ac-ec38-48b8-afa6-80baa37dc156 req-fe435b11-02b5-4c07-832e-02820e0252ff service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:39.021927 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-5f7ba5ac-ec38-48b8-afa6-80baa37dc156 req-fe435b11-02b5-4c07-832e-02820e0252ff service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:39.033503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-5f7ba5ac-ec38-48b8-afa6-80baa37dc156 req-fe435b11-02b5-4c07-832e-02820e0252ff service nova] Creating event network-vif-deleted:da0887a0-7787-4561-9520-968f8cd45bcf for instance 73badc72-7d3b-46a6-937c-aad405645904 on hv-cinder-83538 Jun 24 15:22:39.038799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-5f7ba5ac-ec38-48b8-afa6-80baa37dc156 req-fe435b11-02b5-4c07-832e-02820e0252ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031185 Jun 24 15:22:39.039436 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 242/498] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:39.164653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:39.165253 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:39.172383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:39.172778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:39.174374 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:39.174816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:39.260455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:39.268288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-26a74730-13b3-43af-9752-97779cd93370 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1472 microversion: 2.1 time: 0.107407 Jun 24 15:22:39.268874 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 257/499] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:39 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1472 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:39.383355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:39.384081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:39.390277 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:39.394129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:39.394129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:39.394129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:39.645320 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:39.653237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1fb106c4-1d65-44cb-b654-ab5f3153cbd3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.274175 Jun 24 15:22:39.653807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 243/500] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:39 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:40.285979 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:40.286591 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:40.289258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:40.293983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:40.294439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:40.295299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:40.295755 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:40.364051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:40.373285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-35628ac6-b79b-4f48-90ba-aa52f79aee56 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 200 len: 1303 microversion: 2.1 time: 0.091493 Jun 24 15:22:40.373869 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 258/501] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:40 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:40.669781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:40.670385 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:40.678189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:40.678636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:40.679434 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:40.679872 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:40.887291 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:40.890892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:40.895965 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ebb9fb73-0284-49bf-ba20-729e58281ef8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.230032 Jun 24 15:22:40.896532 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 244/502] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:40 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:41.172191 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-60f92a09-35df-4e96-94bd-a4f9d99eb0ff req-c55477b4-f09c-46db-82cd-cc018f255e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa864c2-63a6-4aa7-8ea6-3ce12daff080", "tag": "e9c0e7f6-a572-47c4-8390-be9bdb776041"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:41.181308 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-60f92a09-35df-4e96-94bd-a4f9d99eb0ff req-c55477b4-f09c-46db-82cd-cc018f255e4c service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:41.181906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-60f92a09-35df-4e96-94bd-a4f9d99eb0ff req-c55477b4-f09c-46db-82cd-cc018f255e4c service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:41.194710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-60f92a09-35df-4e96-94bd-a4f9d99eb0ff req-c55477b4-f09c-46db-82cd-cc018f255e4c service nova] Creating event network-changed:e9c0e7f6-a572-47c4-8390-be9bdb776041 for instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 on hv-cinder-83538 Jun 24 15:22:41.199942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-60f92a09-35df-4e96-94bd-a4f9d99eb0ff req-c55477b4-f09c-46db-82cd-cc018f255e4c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032276 Jun 24 15:22:41.200953 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 259/503] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:41.399301 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:41.400425 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: 73badc72-7d3b-46a6-937c-aad405645904] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:41.415786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:41.419028 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:41.419028 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:41.420875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:41.439607 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] HTTP exception thrown: Instance 73badc72-7d3b-46a6-937c-aad405645904 could not be found. Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Request method failure captured: Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 HTTP/1.1 Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdZVmfVbHWPOw_Rp7xRkqLopKlDlIwGGShx7IUgv3EyJeekNWvesgsjBL_Z-j4iYiRy6i2fXhgWOAzSFyW7DTryBV4BnwAfwKdmfluw9EucW-LVEhRCSG9iDCUgLxaDg2vcYDkrncS33_ivvnlgb1jqiEkba7TjOXZqpyxF64dApEuA Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 90288e11d18a4c58b77d848fdd630535 Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1947462697 Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:22:41.441384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/90288e11d18a4c58b77d848fdd630535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/90288e11d18a4c58b77d848fdd630535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_90288e11d18a4c58b77d848fdd630535", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/90288e11d18a4c58b77d848fdd630535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotTestJSON-1947462697 Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 90288e11d18a4c58b77d848fdd630535 Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1947462697 Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotTestJSON-1947462697-project Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 2321d0531bba403eb552c3a1dbb7484c Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotTestJSON-1947462697-project Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance 73badc72-7d3b-46a6-937c-aad405645904 could not be found. Jun 24 15:22:41.442709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '73badc72-7d3b-46a6-937c-aad405645904'} Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73badc72-7d3b-46a6-937c-aad405645904 could not be found. Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:22:41.443525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73badc72-7d3b-46a6-937c-aad405645904 could not be found. Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73badc72-7d3b-46a6-937c-aad405645904 could not be found. Jun 24 15:22:41.444814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:22:41.453437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Returning 404 to user: Instance 73badc72-7d3b-46a6-937c-aad405645904 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:22:41.453437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bd84cd74-d433-4aff-8475-68d15ffbfa55 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904" status: 404 len: 111 microversion: 2.1 time: 0.056284 Jun 24 15:22:41.453437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 245/504] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:41 2022] GET /compute/v2.1/servers/73badc72-7d3b-46a6-937c-aad405645904 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:22:41.914215 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:41.915645 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:41.922061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:41.922505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:41.924203 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:41.924647 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:42.070306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:42.078591 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c0d4f689-24c3-4675-bc2e-ede098757a9e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.169219 Jun 24 15:22:42.079280 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 260/505] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:41 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:42.481336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8d6e568c-82fa-4fd8-aae7-7b23004dc321 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c23ce3cc-da07-4389-99ed-94603aaef119"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:42.482452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8d6e568c-82fa-4fd8-aae7-7b23004dc321 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:42.488911 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d6e568c-82fa-4fd8-aae7-7b23004dc321 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:42.489357 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d6e568c-82fa-4fd8-aae7-7b23004dc321 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:42.490124 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d6e568c-82fa-4fd8-aae7-7b23004dc321 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:42.490553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8d6e568c-82fa-4fd8-aae7-7b23004dc321 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:43.096592 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:43.097152 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:43.103714 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:43.104165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:43.104935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:43.105371 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:43.108057 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:43.234706 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:43.242711 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-def4c2f8-985e-49cb-92ec-fc1ed45fd206 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.150840 Jun 24 15:22:43.243293 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 261/506] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:43 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:44.260333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:44.260947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:44.268241 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:44.268692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:44.269465 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:44.269904 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:44.400378 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:44.408555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-10550094-8ccc-41d9-8be1-4c16c94551b3 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.151519 Jun 24 15:22:44.409115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 262/507] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:44 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:45.425206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:45.425908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:45.432356 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:45.432796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:45.433553 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:45.433982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:45.456590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8d6e568c-82fa-4fd8-aae7-7b23004dc321 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.978824 Jun 24 15:22:45.461829 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 246/508] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:22:42 2022] POST /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments => generated 194 bytes in 2981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:45.565463 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:45.573506 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9e4c1bd-d504-4c47-912d-c1374fd14bd0 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.152513 Jun 24 15:22:45.574075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 263/509] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:45 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:46.591345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:46.592038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:46.594382 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:46.599773 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:46.600217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:46.600974 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:46.601410 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:46.729549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:46.737869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c3741b11-b0b7-4dfe-9a55-67ba91cd2987 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.150774 Jun 24 15:22:46.738432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 247/510] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:46 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:47.347504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-ce4a7cc9-cc7c-4d71-8c9e-c0358b141909 req-8848c0d3-c32c-4b8f-9263-dfd6722336c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b13f6b-a027-4371-8012-54f025a726fa", "name": "network-vif-plugged", "status": "completed", "tag": "18c7a045-91ca-44b2-abe0-c90523b83549"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:47.357088 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-ce4a7cc9-cc7c-4d71-8c9e-c0358b141909 req-8848c0d3-c32c-4b8f-9263-dfd6722336c9 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:47.357635 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-ce4a7cc9-cc7c-4d71-8c9e-c0358b141909 req-8848c0d3-c32c-4b8f-9263-dfd6722336c9 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:47.368946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-ce4a7cc9-cc7c-4d71-8c9e-c0358b141909 req-8848c0d3-c32c-4b8f-9263-dfd6722336c9 service nova] Creating event network-vif-plugged:18c7a045-91ca-44b2-abe0-c90523b83549 for instance 79b13f6b-a027-4371-8012-54f025a726fa on hv-cinder-83538 Jun 24 15:22:47.374052 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-ce4a7cc9-cc7c-4d71-8c9e-c0358b141909 req-8848c0d3-c32c-4b8f-9263-dfd6722336c9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033292 Jun 24 15:22:47.374732 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 264/511] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:47.755049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:47.755776 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:47.762420 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:47.762949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:47.763808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:47.764242 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:47.890818 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:47.898215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bd4e26ba-0341-4395-bb83-8b0346e07d17 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.147714 Jun 24 15:22:47.898775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 248/512] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:47 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:48.916638 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:48.917333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:48.924170 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:48.924639 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:48.925402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:48.925838 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:49.053407 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:49.060725 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-caaa7b06-182d-40ee-a3b8-92a78918d304 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.148890 Jun 24 15:22:49.061292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 265/513] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:48 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:50.077666 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:50.078198 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:50.085184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:50.085651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:50.086407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:50.086837 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:50.216009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:50.224168 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee384738-882f-4bce-8bff-fe148275951e tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.150433 Jun 24 15:22:50.224736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 249/514] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:50 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:51.241172 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:51.241776 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:51.248447 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:51.248896 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:51.249656 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:51.250117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:51.382834 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:51.390173 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3d22741b-a9df-4f4b-9dca-1efe96e876a2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1358 microversion: 2.1 time: 0.152784 Jun 24 15:22:51.390734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 266/515] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:51 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:51.823897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-192762210", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "networks": [{"uuid": "adb22d0d-9079-4b27-97ea-9d1017ee2036"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:51.876412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] validate_networks() for [('adb22d0d-9079-4b27-97ea-9d1017ee2036', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:22:52.223216 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:22:52.223631 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:22:52.224106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:22:52.224518 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:22:52.224930 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:22:52.233875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.234264 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.235058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.235536 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.253577 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Getting quotas for project 90288e11d18a4c58b77d848fdd630535. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:22:52.257509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Getting quotas for user 2321d0531bba403eb552c3a1dbb7484c and project 90288e11d18a4c58b77d848fdd630535. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:22:52.268626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:22:52.270864 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:22:52.398049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-47850b6a-1b35-41f2-ba7e-e2b3d7a48744 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577916 Jun 24 15:22:52.398685 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 250/516] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:22:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:22:52.407760 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:52.409166 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:52.409656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7e6fb4af-5560-4f7b-8bbb-c4ab6fd7c33a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:52.410260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7e6fb4af-5560-4f7b-8bbb-c4ab6fd7c33a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:52.416897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.417654 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.418535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.419071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.471362 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7e6fb4af-5560-4f7b-8bbb-c4ab6fd7c33a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:52.479072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7e6fb4af-5560-4f7b-8bbb-c4ab6fd7c33a tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1218 microversion: 2.1 time: 0.074188 Jun 24 15:22:52.480024 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 251/517] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:52 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:52.581930 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:52.589412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5f2094b9-7d6c-4ccb-bce9-a305e6aae82b tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1547 microversion: 2.1 time: 0.185741 Jun 24 15:22:52.589971 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 267/518] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:52 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:52.605943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:52.606553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:52.613161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.613617 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.614373 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.614810 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.743127 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:52.751637 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e420be25-e9de-458e-882f-6aab00b7bb13 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1547 microversion: 2.1 time: 0.149323 Jun 24 15:22:52.752922 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 252/519] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:52 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:52.768308 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:52.771757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:52.772550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Searching by: {'deleted': False, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee'} {{(pid=118274) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 15:22:52.779513 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.779969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.780747 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.781176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.872999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.multi_cell_list [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118274) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 15:22:52.970918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5ddc0658-4770-453d-b49c-dce0ab11aa35 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206719 Jun 24 15:22:52.971552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 268/520] 10.222.0.67 () {58 vars in 1124 bytes} [Fri Jun 24 15:22:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:52.981547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:52.982163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:52.989249 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.989701 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:52.990467 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:52.990914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:53.119424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:53.127720 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76a44a37-7ac6-4564-8073-d523ed3848e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1547 microversion: 2.1 time: 0.149201 Jun 24 15:22:53.128476 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 253/521] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:52 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:53.500392 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:53.501065 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:53.509318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:53.510072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:53.510916 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:53.511867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:53.580685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:53.588349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-66551d10-d6d2-4ce1-ac43-1581a63b9d7f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1222 microversion: 2.1 time: 0.092103 Jun 24 15:22:53.588923 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 269/522] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:53 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:54.016313 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:54.017935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:54.024878 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:54.025452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:54.026437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:54.027288 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:54.050721 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lazy-loading 'flavor' on Instance uuid 68a388fa-baf9-475a-9e9e-4b89f267983d {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:22:54.416147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a37f04ff-a1fa-4dd8-bb6e-439476dd607e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/action" status: 200 len: 32 microversion: 2.1 time: 0.403876 Jun 24 15:22:54.417271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 254/523] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:22:54 2022] POST /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/action => generated 32 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:22:54.427654 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:54.428439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:54.434525 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:54.434973 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:54.435781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:54.436215 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:54.610938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:54.614482 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:54.622471 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:54.623332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:54.623741 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:54.624182 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:54.660295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:54.680549 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-54a0fe58-77be-4863-8689-6c58f278667d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.251605 Jun 24 15:22:54.680549 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 270/524] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:54 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:54.713007 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:54.721179 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7ef044ce-981a-4eb1-8be3-1590332ec7b8 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1288 microversion: 2.1 time: 0.117445 Jun 24 15:22:54.722118 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 255/525] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:54 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1288 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:55.144187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e10cbb69-cac6-4cd6-8e13-afa366b7f6c2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "739ed036-0c4c-43ab-87ec-2525ddec0b7c"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:55.145452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e10cbb69-cac6-4cd6-8e13-afa366b7f6c2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:55.153664 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e10cbb69-cac6-4cd6-8e13-afa366b7f6c2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:55.154112 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e10cbb69-cac6-4cd6-8e13-afa366b7f6c2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:55.154894 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e10cbb69-cac6-4cd6-8e13-afa366b7f6c2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:55.155351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e10cbb69-cac6-4cd6-8e13-afa366b7f6c2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:55.693792 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:55.694523 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:55.701358 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:55.701750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:55.702525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:55.702966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:55.941884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:55.949990 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f1628450-3a87-4509-8046-0bfa69d7e1ab tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.260857 Jun 24 15:22:55.950549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 256/526] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:55 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:55.967606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:55.967606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:55.967606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:55.967606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:55.968049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:55.968049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:56.114059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e10cbb69-cac6-4cd6-8e13-afa366b7f6c2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.974097 Jun 24 15:22:56.114745 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 271/527] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:22:55 2022] POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments => generated 194 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:22:56.117129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:56.124944 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8ade0765-e543-4718-8fa0-b69be518bf2d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1318 microversion: 2.1 time: 0.173396 Jun 24 15:22:56.125512 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 257/528] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:55 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:56.479546 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-294dbfea-b731-4da3-bd12-8e914775c506 req-ad707260-9404-4a45-a876-20cda101b234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c15beecb-7a05-45a1-be63-239d26bcb9f5", "tag": "c62be48c-fa1e-4502-b6de-4a100cd9bc71"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:22:56.488505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-294dbfea-b731-4da3-bd12-8e914775c506 req-ad707260-9404-4a45-a876-20cda101b234 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:56.488962 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-294dbfea-b731-4da3-bd12-8e914775c506 req-ad707260-9404-4a45-a876-20cda101b234 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:56.500172 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-294dbfea-b731-4da3-bd12-8e914775c506 req-ad707260-9404-4a45-a876-20cda101b234 service nova] Creating event network-changed:c62be48c-fa1e-4502-b6de-4a100cd9bc71 for instance c15beecb-7a05-45a1-be63-239d26bcb9f5 on hv-cinder-83538 Jun 24 15:22:56.505747 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-294dbfea-b731-4da3-bd12-8e914775c506 req-ad707260-9404-4a45-a876-20cda101b234 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030553 Jun 24 15:22:56.506389 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 272/529] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:22:56.967940 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:56.968555 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:56.975590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:56.976044 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:56.976818 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:56.977258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:57.143569 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:57.144451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:57.150550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:57.151029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:57.152273 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:57.152711 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:57.193387 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:57.202436 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-938e31e2-d55e-494b-b0fd-679a4fa9e7e0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.238538 Jun 24 15:22:57.203081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 258/530] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:56 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:57.345140 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:57.352979 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-154d0307-09ca-446c-8895-35b2cfe454e9 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1318 microversion: 2.1 time: 0.214693 Jun 24 15:22:57.353451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 273/531] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:57 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:58.220341 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:58.220941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:58.227426 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:58.227877 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:58.228638 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:58.229078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:58.357389 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:58.366019 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-af092a7e-3172-4811-9fa8-d87b1c050853 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.149549 Jun 24 15:22:58.366577 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 259/532] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:58 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:58.369415 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:58.370030 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:58.376475 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:58.377660 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:58.378611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:58.379051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:58.504000 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:58.511241 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b7f0a07b-3544-460e-944d-61541348956b tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1318 microversion: 2.1 time: 0.145504 Jun 24 15:22:58.511810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 274/533] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:58 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:22:59.383587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:59.384219 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:59.390577 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:59.391046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:59.391837 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:59.393110 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:59.408838 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:59.524942 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:59.528132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:22:59.528741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:22:59.533572 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4653e3ec-254c-414c-9838-7ec1390b60f1 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.153205 Jun 24 15:22:59.534153 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 260/534] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:59 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:22:59.536109 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:59.536560 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:59.537333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:22:59.537771 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:22:59.674674 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:22:59.683760 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b41bc97c-2dcc-4d37-93ac-c00edfef7f85 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1318 microversion: 2.1 time: 0.159586 Jun 24 15:22:59.684320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 275/535] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:22:59 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:00.553663 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:00.554271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:00.561388 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:00.561842 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:00.562603 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:00.563039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:00.693898 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:00.699978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:00.700584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:00.701784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7ab13a47-b276-4bb4-b39b-49a411b876aa tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.152095 Jun 24 15:23:00.702360 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 261/536] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:00 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:00.707016 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:00.707487 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:00.708245 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:00.708672 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:00.834824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:00.842197 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-47a1bdd2-696a-4868-b93e-2989edb4224d tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1318 microversion: 2.1 time: 0.145917 Jun 24 15:23:00.842766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 276/537] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:00 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:01.410920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-c3c66b51-bb66-4e2e-82e9-954478737932 req-7f1fc546-8e44-44a3-9250-b88a5b183608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15beecb-7a05-45a1-be63-239d26bcb9f5", "name": "network-vif-plugged", "status": "completed", "tag": "c62be48c-fa1e-4502-b6de-4a100cd9bc71"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:01.420386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-c3c66b51-bb66-4e2e-82e9-954478737932 req-7f1fc546-8e44-44a3-9250-b88a5b183608 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:01.420834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-c3c66b51-bb66-4e2e-82e9-954478737932 req-7f1fc546-8e44-44a3-9250-b88a5b183608 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:01.432839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-c3c66b51-bb66-4e2e-82e9-954478737932 req-7f1fc546-8e44-44a3-9250-b88a5b183608 service nova] Creating event network-vif-plugged:c62be48c-fa1e-4502-b6de-4a100cd9bc71 for instance c15beecb-7a05-45a1-be63-239d26bcb9f5 on hv-cinder-83538 Jun 24 15:23:01.437939 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-c3c66b51-bb66-4e2e-82e9-954478737932 req-7f1fc546-8e44-44a3-9250-b88a5b183608 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031147 Jun 24 15:23:01.438738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 262/538] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:01.718164 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:01.718751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:01.725774 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:01.726219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:01.726993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:01.727469 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:01.742408 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:01.860116 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:01.860811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:01.867296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:01.867778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:01.868556 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:01.868995 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:01.888889 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:01.898074 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7b7cd5d4-81f6-475d-bf57-4d4739a79a33 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.183857 Jun 24 15:23:01.898631 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 277/539] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:01 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:01.997506 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:02.005654 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9adb476d-c7a5-480b-a3e1-2ab8c70fc36f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1318 microversion: 2.1 time: 0.150290 Jun 24 15:23:02.006213 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 263/540] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:01 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:02.915713 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:02.916307 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:02.918559 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:02.923983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:02.924511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:02.925302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:02.925733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:03.022496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:03.023137 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:03.025165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:03.025937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=8 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:03.031328 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:03.031782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:03.032550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:03.033757 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:03.056485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:03.066080 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6c010bb7-1a08-4661-96b8-c31368f248f2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.154488 Jun 24 15:23:03.066975 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 278/541] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:02 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:03.165241 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:03.172719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c66e503a-87be-4558-85c8-4bc10d435e33 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1318 microversion: 2.1 time: 0.154138 Jun 24 15:23:03.173400 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 264/542] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:03 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:04.083418 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:04.084062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:04.090654 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.091118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.091931 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.092397 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.189785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:04.190979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:04.197684 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.198135 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.198966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.199617 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.223440 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:04.231429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c8ca79f4-2aad-45e6-8d9a-376815f35a51 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.152908 Jun 24 15:23:04.232615 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 279/543] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:04 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:04.332631 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:04.344841 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-425e3e65-a482-4c0e-a15c-4858669a3b3f tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1507 microversion: 2.1 time: 0.154381 Jun 24 15:23:04.344841 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 265/544] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:04 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:04.356463 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2c2aee6f-6fad-4f1f-8559-5eafe378a0e5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80ba6c06-80f8-4edc-926a-48c5c3e3a4ad", "device": "/dev/sdb"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:04.358059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2c2aee6f-6fad-4f1f-8559-5eafe378a0e5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:04.364691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c2aee6f-6fad-4f1f-8559-5eafe378a0e5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.365140 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c2aee6f-6fad-4f1f-8559-5eafe378a0e5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.365906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c2aee6f-6fad-4f1f-8559-5eafe378a0e5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.366340 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2c2aee6f-6fad-4f1f-8559-5eafe378a0e5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.735103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:04.735738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:04.742436 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.742880 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.743669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:04.744100 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:04.872599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:04.881892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5dddba1e-e654-4376-b6e1-f645812a32e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1593 microversion: 2.1 time: 0.150623 Jun 24 15:23:04.882470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 266/545] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:04 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1593 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:05.063400 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2c2aee6f-6fad-4f1f-8559-5eafe378a0e5 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "POST /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710655 Jun 24 15:23:05.064642 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 280/546] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:23:04 2022] POST /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:05.249205 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:05.249807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:05.257477 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:05.261035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:05.261035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:05.261035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:05.449197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:05.457615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e6eed105-3518-41b9-9258-34620975461e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.212271 Jun 24 15:23:05.458186 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 267/547] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:05 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:06.476085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:06.476821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:06.483063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:06.483552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:06.484333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:06.484783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:06.697068 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:06.705131 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2eb0d6f6-6628-477f-bd0e-0fc560bb8a10 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.234980 Jun 24 15:23:06.706269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 281/548] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:06 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:07.309910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-cf5a8ff7-4022-4418-a263-7a706da5a3a4 req-559dd639-f83b-4ccf-a557-9378d92ba138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b13f6b-a027-4371-8012-54f025a726fa", "tag": "18c7a045-91ca-44b2-abe0-c90523b83549"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:07.319926 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-cf5a8ff7-4022-4418-a263-7a706da5a3a4 req-559dd639-f83b-4ccf-a557-9378d92ba138 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:07.320468 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-cf5a8ff7-4022-4418-a263-7a706da5a3a4 req-559dd639-f83b-4ccf-a557-9378d92ba138 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:07.331914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-cf5a8ff7-4022-4418-a263-7a706da5a3a4 req-559dd639-f83b-4ccf-a557-9378d92ba138 service nova] Creating event network-changed:18c7a045-91ca-44b2-abe0-c90523b83549 for instance 79b13f6b-a027-4371-8012-54f025a726fa on hv-cinder-83538 Jun 24 15:23:07.336979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-cf5a8ff7-4022-4418-a263-7a706da5a3a4 req-559dd639-f83b-4ccf-a557-9378d92ba138 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030970 Jun 24 15:23:07.338024 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 268/549] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:07.722433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:07.723775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:07.730511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:07.731081 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:07.738455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:07.739011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:07.903619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-482fd1d7-428f-4166-aa33-1931e9fa043f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:07.909194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-482fd1d7-428f-4166-aa33-1931e9fa043f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:07.913079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-482fd1d7-428f-4166-aa33-1931e9fa043f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:07.913575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-482fd1d7-428f-4166-aa33-1931e9fa043f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:07.914676 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-482fd1d7-428f-4166-aa33-1931e9fa043f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:07.916963 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-482fd1d7-428f-4166-aa33-1931e9fa043f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:07.952317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-482fd1d7-428f-4166-aa33-1931e9fa043f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments/b8ff1e70-2b0c-4144-9445-2fb7123ccf26" status: 200 len: 194 microversion: 2.20 time: 0.053928 Jun 24 15:23:07.953590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 269/550] 10.222.0.67 () {60 vars in 1453 bytes} [Fri Jun 24 15:23:07 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments/b8ff1e70-2b0c-4144-9445-2fb7123ccf26 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:23:07.986130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:08.003546 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cb1824c5-69a8-4b02-8425-e9ad4f39873d tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.284652 Jun 24 15:23:08.008389 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 282/551] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:07 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:08.043716 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:08.044238 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:08.051280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:08.051734 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:08.052503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:08.052943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:08.184410 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lazy-loading 'services' on Instance uuid e24b4aae-8cee-48cc-bf18-e9a915ea3f2c {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:23:08.474515 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9303cf2f-2f23-4e20-9a01-012bb0420a76 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments/b8ff1e70-2b0c-4144-9445-2fb7123ccf26" status: 202 len: 0 microversion: 2.20 time: 0.434666 Jun 24 15:23:08.475142 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 270/552] 10.222.0.67 () {60 vars in 1456 bytes} [Fri Jun 24 15:23:08 2022] DELETE /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments/b8ff1e70-2b0c-4144-9445-2fb7123ccf26 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:23:08.483691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7dfa3057-e1a3-4126-9d4d-d4e58588702a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:08.484671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7dfa3057-e1a3-4126-9d4d-d4e58588702a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:08.491778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dfa3057-e1a3-4126-9d4d-d4e58588702a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:08.492235 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dfa3057-e1a3-4126-9d4d-d4e58588702a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:08.493071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dfa3057-e1a3-4126-9d4d-d4e58588702a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:08.493523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7dfa3057-e1a3-4126-9d4d-d4e58588702a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:08.524383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7dfa3057-e1a3-4126-9d4d-d4e58588702a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044667 Jun 24 15:23:08.524959 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 283/553] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:08 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:09.022076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:09.022768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:09.031497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:09.031497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:09.031497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:09.031497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:09.164288 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:09.171496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-df0b5c72-9719-4466-8c8f-67b60e5e3902 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.154424 Jun 24 15:23:09.172064 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 271/554] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:09 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:09.536733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-17e51502-13d6-4b49-91ff-8fc40e486925 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:09.537661 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-17e51502-13d6-4b49-91ff-8fc40e486925 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:09.544187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17e51502-13d6-4b49-91ff-8fc40e486925 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:09.544674 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17e51502-13d6-4b49-91ff-8fc40e486925 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:09.545448 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17e51502-13d6-4b49-91ff-8fc40e486925 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:09.545885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17e51502-13d6-4b49-91ff-8fc40e486925 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:09.577009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-17e51502-13d6-4b49-91ff-8fc40e486925 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044535 Jun 24 15:23:09.577562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 284/555] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:09 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:09.681217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-450804945"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:09.682063 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:09.688270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:09.688811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:09.689559 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:09.690860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:09.814676 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.network.security_group_api [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Adding security group 6502aab0-e136-43d0-949d-b9bd8e471beb to port 18c7a045-91ca-44b2-abe0-c90523b83549 Jun 24 15:23:10.188281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:10.188919 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:10.195126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:10.195606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:10.196377 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:10.196812 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:10.295390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bbf355b1-5ee1-4901-84bd-2ddfe2cd7e6f tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/action" status: 202 len: 0 microversion: 2.1 time: 0.615336 Jun 24 15:23:10.295390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 272/556] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:23:09 2022] POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:23:10.303678 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:10.304666 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:10.315031 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:10.315893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:10.317404 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:10.318041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:10.483899 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:10.493504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e2212328-49dd-4fe3-8b23-b958f557a9d8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.309113 Jun 24 15:23:10.494091 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 285/557] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:10 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:10.514643 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-c391092f-6ea0-48ec-a039-4f780809fb98 req-8fa41aa6-f232-4ea4-aa46-70bd5111eedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b13f6b-a027-4371-8012-54f025a726fa", "tag": "18c7a045-91ca-44b2-abe0-c90523b83549"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:10.538682 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-c391092f-6ea0-48ec-a039-4f780809fb98 req-8fa41aa6-f232-4ea4-aa46-70bd5111eedc service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:10.539357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-c391092f-6ea0-48ec-a039-4f780809fb98 req-8fa41aa6-f232-4ea4-aa46-70bd5111eedc service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:10.551878 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-c391092f-6ea0-48ec-a039-4f780809fb98 req-8fa41aa6-f232-4ea4-aa46-70bd5111eedc service nova] Creating event network-changed:18c7a045-91ca-44b2-abe0-c90523b83549 for instance 79b13f6b-a027-4371-8012-54f025a726fa on hv-cinder-83538 Jun 24 15:23:10.557451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-c391092f-6ea0-48ec-a039-4f780809fb98 req-8fa41aa6-f232-4ea4-aa46-70bd5111eedc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048396 Jun 24 15:23:10.562027 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 286/558] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:10.591977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-405bad29-4e93-434c-ab66-d7774d0ae80b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:10.591977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-405bad29-4e93-434c-ab66-d7774d0ae80b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:10.592203 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:10.598915 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-405bad29-4e93-434c-ab66-d7774d0ae80b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:10.599725 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-405bad29-4e93-434c-ab66-d7774d0ae80b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:10.600757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-405bad29-4e93-434c-ab66-d7774d0ae80b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:10.601115 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f79ed9c3-3cce-4fb4-97f0-da9103e1dd33 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1757 microversion: 2.1 time: 0.302241 Jun 24 15:23:10.601650 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-405bad29-4e93-434c-ab66-d7774d0ae80b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:10.601766 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 273/559] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:10 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1757 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:10.640266 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-405bad29-4e93-434c-ab66-d7774d0ae80b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055187 Jun 24 15:23:10.640930 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 287/560] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:10 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:23:11.515056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:11.515690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:11.522316 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:11.522758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:11.523536 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:11.523966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:11.653525 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dfe09ac3-1ca0-4134-aea4-7dc835aba0f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:11.654312 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dfe09ac3-1ca0-4134-aea4-7dc835aba0f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:11.655905 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:11.656763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=60 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:11.662494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe09ac3-1ca0-4134-aea4-7dc835aba0f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:11.662942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe09ac3-1ca0-4134-aea4-7dc835aba0f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:11.663733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe09ac3-1ca0-4134-aea4-7dc835aba0f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:11.664168 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dfe09ac3-1ca0-4134-aea4-7dc835aba0f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:11.669819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0d0afe5e-4449-4fd9-8c76-d6b3971f70a0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.153439 Jun 24 15:23:11.669819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 274/561] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:11 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:11.692734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dfe09ac3-1ca0-4134-aea4-7dc835aba0f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043462 Jun 24 15:23:11.693211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 288/562] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:11 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:23:12.685350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:12.685959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:12.693091 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:12.693489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:12.694246 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:12.694683 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:12.705423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e1250e9f-ac7f-4b4f-871c-68e7341934b5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:12.714612 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e1250e9f-ac7f-4b4f-871c-68e7341934b5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:12.721593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1250e9f-ac7f-4b4f-871c-68e7341934b5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:12.722113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1250e9f-ac7f-4b4f-871c-68e7341934b5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:12.722950 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1250e9f-ac7f-4b4f-871c-68e7341934b5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:12.723470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1250e9f-ac7f-4b4f-871c-68e7341934b5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:12.753884 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e1250e9f-ac7f-4b4f-871c-68e7341934b5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052473 Jun 24 15:23:12.754782 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 289/563] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:12 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:12.823348 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:12.831518 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cc0fb8e1-c11e-4470-889e-b7b4629305fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.149789 Jun 24 15:23:12.832077 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 275/564] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:12 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:13.766023 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-36cef859-4e1d-4d81-8285-3743db938e6d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:13.767715 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-36cef859-4e1d-4d81-8285-3743db938e6d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:13.774810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36cef859-4e1d-4d81-8285-3743db938e6d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:13.775292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36cef859-4e1d-4d81-8285-3743db938e6d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:13.776071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36cef859-4e1d-4d81-8285-3743db938e6d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:13.776771 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36cef859-4e1d-4d81-8285-3743db938e6d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:13.805420 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-36cef859-4e1d-4d81-8285-3743db938e6d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043568 Jun 24 15:23:13.805980 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 290/565] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:13 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:13.848528 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:13.849136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:13.855804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:13.856249 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:13.857045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:13.857473 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:13.990528 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:13.998840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f07ceac6-cffa-417a-b63d-cedbb2a29cef tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1734 microversion: 2.1 time: 0.154414 Jun 24 15:23:13.999423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 276/566] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:13 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:14.817992 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-666ecff7-d3bc-4947-8a6b-7bdb254dfa9a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:14.818909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-666ecff7-d3bc-4947-8a6b-7bdb254dfa9a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:14.825422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-666ecff7-d3bc-4947-8a6b-7bdb254dfa9a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:14.825877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-666ecff7-d3bc-4947-8a6b-7bdb254dfa9a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:14.826643 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-666ecff7-d3bc-4947-8a6b-7bdb254dfa9a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:14.827082 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-666ecff7-d3bc-4947-8a6b-7bdb254dfa9a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:14.855346 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-666ecff7-d3bc-4947-8a6b-7bdb254dfa9a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042159 Jun 24 15:23:14.855900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 291/567] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:14 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:15.022108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:15.022713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:15.029426 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.029867 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.030619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.031048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.163949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:15.171939 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-acef4f62-7b3b-4d8a-9d1b-adc8dcfb44a7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1714 microversion: 2.1 time: 0.154090 Jun 24 15:23:15.172504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 277/568] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:15 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:15.273291 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:15.273787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:15.280101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.280533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.281301 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.281735 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.360802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] HTTP exception thrown: Cannot 'detach_volume' instance 68a388fa-baf9-475a-9e9e-4b89f267983d while it is in vm_state rescued Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Request method failure captured: Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments/c23ce3cc-da07-4389-99ed-94603aaef119 HTTP/1.1 Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXTm1kZ83vG0dVn9_eQU34jeaIS5Xs1kwFIHFrRcoFU5BwqAOFrPmil7zy7R1kti-JyFTcOryxCr-ifJqmjVaccKZqUW0NzOwvA6tjKh9i2VEhxAP-ir2UKSYsaLi_a3l93CWfiWHhabKVeTmWfW4WjSkhckXMByI88sL4WOnXU9pM Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:23:15.362413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6bf0e1123fa47a7844e09127fb16d6e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: b67761f9b13340a090efc1cb07714912 Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:23:15.365013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Cannot 'detach_volume' instance 68a388fa-baf9-475a-9e9e-4b89f267983d while it is in vm_state rescued Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '68a388fa-baf9-475a-9e9e-4b89f267983d', 'id': 'c23ce3cc-da07-4389-99ed-94603aaef119'} Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68a388fa-baf9-475a-9e9e-4b89f267983d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:23:15.365900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 68a388fa-baf9-475a-9e9e-4b89f267983d while it is in vm_state rescued Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 68a388fa-baf9-475a-9e9e-4b89f267983d while it is in vm_state rescued Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:23:15.367567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Returning 409 to user: Cannot 'detach_volume' instance 68a388fa-baf9-475a-9e9e-4b89f267983d while it is in vm_state rescued {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:23:15.368932 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-06aa83c0-4c5c-4be8-b568-c05099a8cac2 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "DELETE /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments/c23ce3cc-da07-4389-99ed-94603aaef119" status: 409 len: 152 microversion: 2.1 time: 0.095742 Jun 24 15:23:15.368932 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 292/569] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:23:15 2022] DELETE /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments/c23ce3cc-da07-4389-99ed-94603aaef119 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 15:23:15.373783 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0ff87296-5fa2-4d92-9a7a-93c9b83aba5b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:15.374317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0ff87296-5fa2-4d92-9a7a-93c9b83aba5b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:15.380613 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ff87296-5fa2-4d92-9a7a-93c9b83aba5b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.381065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ff87296-5fa2-4d92-9a7a-93c9b83aba5b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.381830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ff87296-5fa2-4d92-9a7a-93c9b83aba5b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.382271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ff87296-5fa2-4d92-9a7a-93c9b83aba5b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.385931 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:15.588243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0ff87296-5fa2-4d92-9a7a-93c9b83aba5b tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "POST /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/action" status: 202 len: 0 microversion: 2.1 time: 0.218013 Jun 24 15:23:15.589027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 278/570] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:23:15 2022] POST /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:23:15.597766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:15.598641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:15.605788 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.606180 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.606947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.607449 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.622116 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:15.735419 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:15.743368 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5774fded-cab5-4981-ae36-2fd05cfdd69c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.150108 Jun 24 15:23:15.743915 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 293/571] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:15 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:15.867949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fbd68503-5022-4df7-8f5f-6d97e248d5dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:15.868933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fbd68503-5022-4df7-8f5f-6d97e248d5dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:15.874983 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fbd68503-5022-4df7-8f5f-6d97e248d5dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.875466 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fbd68503-5022-4df7-8f5f-6d97e248d5dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.876224 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fbd68503-5022-4df7-8f5f-6d97e248d5dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:15.876654 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fbd68503-5022-4df7-8f5f-6d97e248d5dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:15.905817 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fbd68503-5022-4df7-8f5f-6d97e248d5dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042388 Jun 24 15:23:15.906349 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 279/572] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:15 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:16.759943 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:16.760553 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:16.767034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:16.767527 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:16.768272 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:16.768707 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:16.899514 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:16.907615 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5bbd84fa-2f78-4890-b95a-b16fb377765a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.151515 Jun 24 15:23:16.908177 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 294/573] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:16 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:16.917566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-76915bbf-d56d-4409-af4d-593bf04de8bc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:16.918582 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-76915bbf-d56d-4409-af4d-593bf04de8bc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:16.921008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:16.925644 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76915bbf-d56d-4409-af4d-593bf04de8bc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:16.926084 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76915bbf-d56d-4409-af4d-593bf04de8bc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:16.926835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76915bbf-d56d-4409-af4d-593bf04de8bc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:16.927320 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-76915bbf-d56d-4409-af4d-593bf04de8bc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:16.955488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-76915bbf-d56d-4409-af4d-593bf04de8bc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041838 Jun 24 15:23:16.956030 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 280/574] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:16 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:17.926289 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:17.926890 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:17.933346 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:17.933791 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:17.934554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:17.934988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:17.967885 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-99c609bc-d177-4552-b011-ac79966d2b69 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:17.968901 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-99c609bc-d177-4552-b011-ac79966d2b69 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:17.978553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99c609bc-d177-4552-b011-ac79966d2b69 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:17.979008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99c609bc-d177-4552-b011-ac79966d2b69 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:17.979819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99c609bc-d177-4552-b011-ac79966d2b69 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:17.980253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-99c609bc-d177-4552-b011-ac79966d2b69 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:18.014458 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-99c609bc-d177-4552-b011-ac79966d2b69 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050708 Jun 24 15:23:18.014967 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 281/575] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:17 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:23:18.072086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:18.080176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cc84cd9f-4e82-48b0-9d4f-b495e41166cd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.158212 Jun 24 15:23:18.081025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 295/576] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:17 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:19.026078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bbcba899-f01f-40da-88c7-4fce0e56fbde tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:19.027273 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bbcba899-f01f-40da-88c7-4fce0e56fbde tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:19.033646 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbcba899-f01f-40da-88c7-4fce0e56fbde tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.034086 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbcba899-f01f-40da-88c7-4fce0e56fbde tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.035550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbcba899-f01f-40da-88c7-4fce0e56fbde tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.035978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbcba899-f01f-40da-88c7-4fce0e56fbde tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.063937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bbcba899-f01f-40da-88c7-4fce0e56fbde tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041791 Jun 24 15:23:19.064479 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 282/577] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:23:19 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:19.098355 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:19.098977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:19.105689 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.106136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.106959 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.107422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.129347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:19.129838 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:19.135956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.136407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.137163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.137596 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.163992 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:23:19.235849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:19.243978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eafdf313-11ff-44bb-80bf-da289cf60d65 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.151000 Jun 24 15:23:19.244545 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 296/578] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:19 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:19.413412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b2338f14-fbd9-4698-8b3b-8f6332d1c70a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 204 len: 0 microversion: 2.20 time: 0.287879 Jun 24 15:23:19.414126 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 283/579] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Jun 24 15:23:19 2022] DELETE /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 15:23:19.422548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:19.424644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:19.429938 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.430418 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.431247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:19.431659 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:19.563532 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:19.572411 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:19.573929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:19.575110 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fea3d8c9-25c4-4b1d-b786-d00c02e54abf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.156531 Jun 24 15:23:19.575691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 297/580] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:19 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:20.261637 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:20.262338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:20.268804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:20.269525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:20.270294 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:20.270738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:20.398745 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:20.407101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fdbf2f07-c836-476a-adce-212df202c168 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.149649 Jun 24 15:23:20.407697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 284/581] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:20 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:20.593691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:20.596281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:20.601361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:20.601753 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:20.602516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:20.602946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:20.734486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:20.742359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:20.743895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:20.745040 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0b01e5b6-8cf7-495d-ad81-1ee763f542e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.155216 Jun 24 15:23:20.745591 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 298/582] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:20 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:21.425652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:21.426535 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:21.433079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:21.433552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:21.434310 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:21.434784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:21.563440 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:21.572272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-856b048c-7fc0-47ab-9194-16e1db678e24 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.151166 Jun 24 15:23:21.572843 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 285/583] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:21 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:21.763740 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:21.764325 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:21.771251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:21.771705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:21.772473 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:21.772911 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:21.899614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:21.907662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:21.909641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:21.911097 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c1a2ba90-cad8-497e-a7da-860858e492c5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.151284 Jun 24 15:23:21.911694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 299/584] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:21 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:22.589874 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:22.590479 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:22.597116 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:22.597556 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:22.598307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:22.598736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:22.734166 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:22.742218 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8b2cebef-2a4d-41f9-b191-e9f1e6214357 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.156131 Jun 24 15:23:22.742788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 286/585] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:22 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:22.929564 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:22.930155 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:22.936601 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:22.937049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:22.937811 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:22.938246 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:23.065969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:23.074367 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:23.075900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:23.077042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-af50f5d6-8c45-443e-b25f-24d665101971 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.151807 Jun 24 15:23:23.077614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 300/586] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:22 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:23.759944 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:23.760587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:23.767042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:23.767551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:23.768320 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:23.768760 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:23.907032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:23.915014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2bda4e9a-b896-4dd1-b34c-a9159c51e460 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.159051 Jun 24 15:23:23.915631 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 287/587] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:23 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:24.095308 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:24.095851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:24.103254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:24.103711 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:24.104484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:24.104921 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:24.233039 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:24.241693 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:24.243196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:24.244335 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-36647877-79d5-4f2e-b07b-66d3a5b03666 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.153023 Jun 24 15:23:24.244889 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 301/588] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:24 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:24.932078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:24.932689 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:24.938674 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:24.939129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:24.939974 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:24.940412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:25.077097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:25.084452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-eb5f7f42-97e1-4ec3-9921-1d1ee230ddca tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1722 microversion: 2.1 time: 0.156419 Jun 24 15:23:25.085017 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 288/589] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:24 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:25.262304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:25.262908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:25.269404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:25.269851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:25.270751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:25.271200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:25.400957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:25.409045 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:25.410601 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:25.411785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-eb49c264-4e7d-4004-8b5b-f5a5da008ab4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.153412 Jun 24 15:23:25.412340 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 302/590] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:25 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:26.102347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:26.103061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:26.110255 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.110712 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.111542 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.111985 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.218826 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:26.219339 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:26.226224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.226867 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.227632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.228061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.310596 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lazy-loading 'services' on Instance uuid c15beecb-7a05-45a1-be63-239d26bcb9f5 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:23:26.498713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:26.508584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5469eba9-4fcc-4c0f-8c0a-6f4f04af4fdb tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5/os-volume_attachments/80ba6c06-80f8-4edc-926a-48c5c3e3a4ad" status: 202 len: 0 microversion: 2.1 time: 0.293605 Jun 24 15:23:26.511749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b23a5af5-04d5-489e-8f4a-10ffece04d75 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1728 microversion: 2.1 time: 0.411035 Jun 24 15:23:26.511871 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 303/591] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:23:26 2022] DELETE /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5/os-volume_attachments/80ba6c06-80f8-4edc-926a-48c5c3e3a4ad => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 15:23:26.512956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 289/592] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:26 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1728 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:26.515627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:26.516736 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:26.529278 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4cf90dc8-87a7-462e-9ed3-2966268f079a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:26.535300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.535300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.535300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.535300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.535961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4cf90dc8-87a7-462e-9ed3-2966268f079a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:26.543935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cf90dc8-87a7-462e-9ed3-2966268f079a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.544706 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cf90dc8-87a7-462e-9ed3-2966268f079a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.545659 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cf90dc8-87a7-462e-9ed3-2966268f079a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:26.546263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4cf90dc8-87a7-462e-9ed3-2966268f079a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:26.685855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4cf90dc8-87a7-462e-9ed3-2966268f079a tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160860 Jun 24 15:23:26.686698 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 290/593] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:23:26 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:26.748734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:26.758360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:26.759993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:26.761412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d3c98b29-abd8-49d6-aae6-1391f93b5855 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1722 microversion: 2.20 time: 0.250572 Jun 24 15:23:26.762173 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 304/594] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:26 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:27.075373 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-2cd79f55-153e-427d-aad0-313fdd69f728 req-1d262b0e-3a79-4be1-9d43-4971511da8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24b4aae-8cee-48cc-bf18-e9a915ea3f2c", "name": "network-vif-deleted", "tag": "5f0c5043-24b7-4a39-9766-66475f0cad69"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:27.086321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2cd79f55-153e-427d-aad0-313fdd69f728 req-1d262b0e-3a79-4be1-9d43-4971511da8e2 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:27.087014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2cd79f55-153e-427d-aad0-313fdd69f728 req-1d262b0e-3a79-4be1-9d43-4971511da8e2 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:27.103385 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-2cd79f55-153e-427d-aad0-313fdd69f728 req-1d262b0e-3a79-4be1-9d43-4971511da8e2 service nova] Creating event network-vif-deleted:5f0c5043-24b7-4a39-9766-66475f0cad69 for instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c on hv-cinder-83538 Jun 24 15:23:27.110478 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-2cd79f55-153e-427d-aad0-313fdd69f728 req-1d262b0e-3a79-4be1-9d43-4971511da8e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040203 Jun 24 15:23:27.111738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 291/595] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:27.784002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:27.784681 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:27.792143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:27.792710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:27.793607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:27.794115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:27.830778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:27.831600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:27.832057 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lazy-loading 'fault' on Instance uuid e24b4aae-8cee-48cc-bf18-e9a915ea3f2c {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:23:27.878439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:27.888785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:27.891944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:27.893308 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b75d9b4f-08b3-46de-9a4b-6abfed56ee42 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 200 len: 1370 microversion: 2.20 time: 0.114841 Jun 24 15:23:27.894427 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 305/596] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:27 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:27.958925 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-31e13429-6147-4c2c-be0b-60080341967a req-cc45ca0b-2c66-497d-bd08-e18f86157101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a388fa-baf9-475a-9e9e-4b89f267983d", "tag": "f136a5f8-c1cb-48a1-8b07-9b685830d3b5"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:27.973877 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-31e13429-6147-4c2c-be0b-60080341967a req-cc45ca0b-2c66-497d-bd08-e18f86157101 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:27.975217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-31e13429-6147-4c2c-be0b-60080341967a req-cc45ca0b-2c66-497d-bd08-e18f86157101 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:27.993980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-31e13429-6147-4c2c-be0b-60080341967a req-cc45ca0b-2c66-497d-bd08-e18f86157101 service nova] Creating event network-changed:f136a5f8-c1cb-48a1-8b07-9b685830d3b5 for instance 68a388fa-baf9-475a-9e9e-4b89f267983d on hv-cinder-83538 Jun 24 15:23:27.999922 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-31e13429-6147-4c2c-be0b-60080341967a req-cc45ca0b-2c66-497d-bd08-e18f86157101 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045406 Jun 24 15:23:28.006491 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 292/597] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:28.702876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:28.703406 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:28.710623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:28.711297 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:28.712129 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:28.712556 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:28.737741 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:23:28.913825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:28.916009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:28.924529 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:28.925474 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:28.927252 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:28.928048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:28.945431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] HTTP exception thrown: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Request method failure captured: Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c HTTP/1.1 Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXTIiYuacPdHWX3E1lUHFgtQMijXcnvYw2JPcLtOPfV0_8pb7xj0ucDbp_9bewf8RR6-2tLzGiEY2eT4t3YmlZaOLBdmNGbwzGTQegnkpIG3pZ1vlOHdUn6nHD8yhIwJxev9CCD8M6pemSPIummUMUgE23ZTfi090IlCTFtJxzWLb0 Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:23:28.947194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c4807ce933f14af0be22dd1cf3635c2f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 206ca9f278fc47e4a9a4f720083e91f3 Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:23:28.948929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'e24b4aae-8cee-48cc-bf18-e9a915ea3f2c'} Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:23:28.949875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:23:28.951540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:28.953144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Returning 404 to user: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:23:28.953144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-534bc60d-a40a-4951-bd15-a1c28d1fa7ea tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 404 len: 111 microversion: 2.20 time: 0.039829 Jun 24 15:23:28.953144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 293/598] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:28 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:23:28.957219 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0a3dc1dd-6914-4af4-be2b-1b33aad5794b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '.version_select at 0x7f18b206dc10>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:28.991611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a2ad2b6e-5b5d-46da-9ec7-9dfe5c22f7ca tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 204 len: 0 microversion: 2.1 time: 0.292391 Jun 24 15:23:28.992318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 306/599] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:23:28 2022] DELETE /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:23:29.001051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:29.001731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:29.008771 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:29.009277 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:29.010048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:29.010489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:29.028875 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:29.041508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0a3dc1dd-6914-4af4-be2b-1b33aad5794b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166697729" status: 204 len: 0 microversion: 2.20 time: 0.087739 Jun 24 15:23:29.042360 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 294/600] 10.222.0.67 () {60 vars in 1258 bytes} [Fri Jun 24 15:23:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166697729 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 15:23:29.166869 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:29.175949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c421f8d5-08ee-4f83-a1bb-d5b32b75fc45 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1513 microversion: 2.1 time: 0.178713 Jun 24 15:23:29.176790 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 307/601] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:28 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:29.881200 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ef181d3e-dac2-4fa2-b5d0-59d6d167ff6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'create', calling method: .version_select at 0x7f18b2136430>, body: {"keypair": {"name": "tempest-keypair-1123490869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAawb9oF3hnCU/WLqIypnxyGozTWo2SGOEkTFdKMLGq0e39Hx1f/LmOTpLSCSSAI03XJAy0T2bITm33IchCLnbeezasTevE0zxqrMwuPyv96u9W0DOlsCujoH/+2fGUT3w=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:29.896313 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-ef181d3e-dac2-4fa2-b5d0-59d6d167ff6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:23:29.900399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-ef181d3e-dac2-4fa2-b5d0-59d6d167ff6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for user 206ca9f278fc47e4a9a4f720083e91f3 and project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:23:30.009237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ef181d3e-dac2-4fa2-b5d0-59d6d167ff6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.132052 Jun 24 15:23:30.015509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 295/602] 10.222.0.67 () {62 vars in 1199 bytes} [Fri Jun 24 15:23:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 15:23:30.015629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-5c014f5f-81b0-4aea-b204-f230cc333ad4 req-7dea3597-5c97-47d7-8add-4e4b14c04f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a388fa-baf9-475a-9e9e-4b89f267983d", "tag": "f136a5f8-c1cb-48a1-8b07-9b685830d3b5"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:30.024733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5c014f5f-81b0-4aea-b204-f230cc333ad4 req-7dea3597-5c97-47d7-8add-4e4b14c04f6c service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:30.025182 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5c014f5f-81b0-4aea-b204-f230cc333ad4 req-7dea3597-5c97-47d7-8add-4e4b14c04f6c service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:30.036968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-5c014f5f-81b0-4aea-b204-f230cc333ad4 req-7dea3597-5c97-47d7-8add-4e4b14c04f6c service nova] Creating event network-changed:f136a5f8-c1cb-48a1-8b07-9b685830d3b5 for instance 68a388fa-baf9-475a-9e9e-4b89f267983d on hv-cinder-83538 Jun 24 15:23:30.041871 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-5c014f5f-81b0-4aea-b204-f230cc333ad4 req-7dea3597-5c97-47d7-8add-4e4b14c04f6c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030968 Jun 24 15:23:30.042492 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 308/603] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:23:30.193395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:30.194008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:30.200803 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:30.201249 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:30.202000 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:30.202431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:30.217304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:30.359138 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:30.368069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-62a62c32-edf9-46b0-87f8-450956fe89b0 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1513 microversion: 2.1 time: 0.179250 Jun 24 15:23:30.368655 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 296/604] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:30 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:31.389485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:31.390206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:31.398936 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:31.399643 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:31.400590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:31.401476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:31.482769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321d0531bba403eb552c3a1dbb7484c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90288e11d18a4c58b77d848fdd630535', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:31.491862 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d371a1b4-ac1a-481d-b22f-fd5af1ad6812 tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 200 len: 1471 microversion: 2.1 time: 0.110316 Jun 24 15:23:31.492448 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 309/605] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:31 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 1471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:32.057144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-dddf45eb-b58d-4f19-ba47-973762d7e39a req-96773565-6e9b-431c-b1cc-de509df3eb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15beecb-7a05-45a1-be63-239d26bcb9f5", "name": "network-vif-deleted", "tag": "c62be48c-fa1e-4502-b6de-4a100cd9bc71"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:32.065605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-dddf45eb-b58d-4f19-ba47-973762d7e39a req-96773565-6e9b-431c-b1cc-de509df3eb1e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:32.066047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-dddf45eb-b58d-4f19-ba47-973762d7e39a req-96773565-6e9b-431c-b1cc-de509df3eb1e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:32.077280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-dddf45eb-b58d-4f19-ba47-973762d7e39a req-96773565-6e9b-431c-b1cc-de509df3eb1e service nova] Creating event network-vif-deleted:c62be48c-fa1e-4502-b6de-4a100cd9bc71 for instance c15beecb-7a05-45a1-be63-239d26bcb9f5 on hv-cinder-83538 Jun 24 15:23:32.081979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-dddf45eb-b58d-4f19-ba47-973762d7e39a req-96773565-6e9b-431c-b1cc-de509df3eb1e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028770 Jun 24 15:23:32.087838 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 297/606] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:32.385654 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-511900656", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d1ef1dd-ee8a-4e52-9261-de77d4e705e2"}], "security_groups": [{"name": "tempest-securitygroup--2047271856"}], "key_name": "tempest-keypair-1123490869", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:32.509523 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:32.510210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] [instance: c15beecb-7a05-45a1-be63-239d26bcb9f5] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:32.516986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:32.517425 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:32.518187 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:32.518617 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:32.532997 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] HTTP exception thrown: Instance c15beecb-7a05-45a1-be63-239d26bcb9f5 could not be found. Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Request method failure captured: Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 HTTP/1.1 Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdZVmfVbHWPOw_Rp7xRkqLopKlDlIwGGShx7IUgv3EyJeekNWvesgsjBL_Z-j4iYiRy6i2fXhgWOAzSFyW7DTryBV4BnwAfwKdmfluw9EucW-LVEhRCSG9iDCUgLxaDg2vcYDkrncS33_ivvnlgb1jqiEkba7TjOXZqpyxF64dApEuA Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 90288e11d18a4c58b77d848fdd630535 Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1947462697 Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:23:32.534694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/90288e11d18a4c58b77d848fdd630535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/90288e11d18a4c58b77d848fdd630535"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_90288e11d18a4c58b77d848fdd630535", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/90288e11d18a4c58b77d848fdd630535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-VolumesSnapshotTestJSON-1947462697 Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 90288e11d18a4c58b77d848fdd630535 Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1947462697 Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-VolumesSnapshotTestJSON-1947462697-project Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 2321d0531bba403eb552c3a1dbb7484c Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-VolumesSnapshotTestJSON-1947462697-project Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance c15beecb-7a05-45a1-be63-239d26bcb9f5 could not be found. Jun 24 15:23:32.536262 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'c15beecb-7a05-45a1-be63-239d26bcb9f5'} Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15beecb-7a05-45a1-be63-239d26bcb9f5 could not be found. Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:23:32.537193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15beecb-7a05-45a1-be63-239d26bcb9f5 could not be found. Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15beecb-7a05-45a1-be63-239d26bcb9f5 could not be found. Jun 24 15:23:32.538355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:23:32.539493 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] Returning 404 to user: Instance c15beecb-7a05-45a1-be63-239d26bcb9f5 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:23:32.539493 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dfc732ee-3f4d-4eb7-89b4-d5690d23c39e tempest-VolumesSnapshotTestJSON-1947462697 tempest-VolumesSnapshotTestJSON-1947462697-project] 10.222.0.67 "GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5" status: 404 len: 111 microversion: 2.1 time: 0.031742 Jun 24 15:23:32.539493 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 298/607] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:32 2022] GET /compute/v2.1/servers/c15beecb-7a05-45a1-be63-239d26bcb9f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:23:32.653868 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] validate_networks() for [('6d1ef1dd-ee8a-4e52-9261-de77d4e705e2', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:23:33.025616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:23:33.026042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:23:33.026772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:23:33.027200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:23:33.027624 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:23:33.037459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:33.037914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:33.038722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:33.039165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:33.057750 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:23:33.062696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Getting quotas for user 206ca9f278fc47e4a9a4f720083e91f3 and project c4807ce933f14af0be22dd1cf3635c2f. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:23:33.074694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:23:33.077200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:23:33.224792 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d76402c5-88c7-47a3-b4eb-d550198f44ee tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.843343 Jun 24 15:23:33.225439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 310/608] 10.222.0.67 () {62 vars in 1187 bytes} [Fri Jun 24 15:23:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 15:23:33.235256 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ac3d5bc9-4c79-4620-a5be-3f6e1f88432c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:33.235871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ac3d5bc9-4c79-4620-a5be-3f6e1f88432c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:33.293038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ac3d5bc9-4c79-4620-a5be-3f6e1f88432c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:33.300178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ac3d5bc9-4c79-4620-a5be-3f6e1f88432c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:33.302466 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ac3d5bc9-4c79-4620-a5be-3f6e1f88432c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:33.303606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ac3d5bc9-4c79-4620-a5be-3f6e1f88432c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1281 microversion: 2.20 time: 0.072153 Jun 24 15:23:33.305971 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 299/609] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:33 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:34.321891 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:34.322499 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:34.330042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:34.330492 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:34.331370 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:34.331810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:34.391987 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:34.400032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:34.401783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:34.402861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c7acf58a-884c-4162-a5bd-8cff562f80c7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1285 microversion: 2.20 time: 0.085669 Jun 24 15:23:34.403446 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 311/610] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:34 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:35.421237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:35.421879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:35.430103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:35.430554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:35.431359 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:35.431797 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:35.776701 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:35.784942 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:35.786429 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:35.788354 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-68513047-ebc4-4c5e-8c0c-2684c094ad7a tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1333 microversion: 2.20 time: 0.370831 Jun 24 15:23:35.788907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 300/611] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:35 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1333 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:36.806947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:36.807518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:36.813960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:36.814402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:36.815169 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:36.815623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:36.875721 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:36.883651 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:36.885138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:36.886209 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-18ff2dff-cebd-49d2-bede-6f144b5451ff tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1333 microversion: 2.20 time: 0.083959 Jun 24 15:23:36.886757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 312/612] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:36 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:37.904205 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:37.904767 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:37.911396 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:37.914128 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:37.914128 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:37.914128 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:37.974633 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:37.983075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:37.984595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:37.985736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-229def47-1d77-4485-91c9-8f339b22f585 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1333 microversion: 2.20 time: 0.085702 Jun 24 15:23:37.986291 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 301/613] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:37 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:39.003675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:39.004282 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:39.011219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:39.011984 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:39.012963 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:39.013838 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:39.159306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:39.168028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:39.171489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:39.171489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ed7edd80-80f6-4c0a-ae0d-9e88bc298ee3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.170839 Jun 24 15:23:39.171489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 313/614] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:38 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:39.776302 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-4f34ceb0-6df6-4c7f-9ecb-3776e9cfadb9 req-a69402fa-cac0-4634-9ef7-dbcb229c8a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffef349a-ea09-44f9-9cd1-cf5d9b905e50", "tag": "98f0ee1c-7936-46ad-937e-8e43f17d155f"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:39.785988 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4f34ceb0-6df6-4c7f-9ecb-3776e9cfadb9 req-a69402fa-cac0-4634-9ef7-dbcb229c8a12 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:39.786711 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4f34ceb0-6df6-4c7f-9ecb-3776e9cfadb9 req-a69402fa-cac0-4634-9ef7-dbcb229c8a12 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:39.800486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-4f34ceb0-6df6-4c7f-9ecb-3776e9cfadb9 req-a69402fa-cac0-4634-9ef7-dbcb229c8a12 service nova] Creating event network-changed:98f0ee1c-7936-46ad-937e-8e43f17d155f for instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 on hv-cinder-83538 Jun 24 15:23:39.805768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-4f34ceb0-6df6-4c7f-9ecb-3776e9cfadb9 req-a69402fa-cac0-4634-9ef7-dbcb229c8a12 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035019 Jun 24 15:23:39.806378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 302/615] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:40.189105 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:40.194548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:40.196952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:40.197394 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:40.198157 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:40.198587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:40.334801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:40.343774 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:40.345280 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:40.346470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-96d01b5d-c273-4cf2-87ea-ac77378c0f28 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.161278 Jun 24 15:23:40.347266 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 314/616] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:40 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:41.364657 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:41.365431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:41.372171 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:41.372622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:41.373386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:41.373824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:41.501183 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:41.509890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:41.511423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:41.512520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-af99a6b0-6e46-4b50-895d-cf7b4a8c3158 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.152188 Jun 24 15:23:41.513079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 303/617] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:41 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:42.492452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8540daa2-f15e-4198-b9ba-320ed1af6eff tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:42.493479 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8540daa2-f15e-4198-b9ba-320ed1af6eff tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:42.499986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8540daa2-f15e-4198-b9ba-320ed1af6eff tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:42.500443 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8540daa2-f15e-4198-b9ba-320ed1af6eff tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:42.501242 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8540daa2-f15e-4198-b9ba-320ed1af6eff tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:42.501747 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8540daa2-f15e-4198-b9ba-320ed1af6eff tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:42.531943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:42.532548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:42.539144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:42.539623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:42.540393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:42.540832 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:42.673892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:42.682384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:42.684004 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:42.685182 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cac54362-f8a7-442e-b980-ed707d2f8c74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.157630 Jun 24 15:23:42.685729 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 304/618] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:42 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:23:42.698956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8540daa2-f15e-4198-b9ba-320ed1af6eff tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/action" status: 202 len: 0 microversion: 2.1 time: 0.211100 Jun 24 15:23:42.699632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 315/619] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:23:42 2022] POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:23:42.707513 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:42.708120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:42.714192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:42.717148 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:42.717148 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:42.717148 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:42.863210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:42.871617 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9bd05c6f-1c5e-4738-b005-a428b52ef0fa tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1749 microversion: 2.1 time: 0.167835 Jun 24 15:23:42.872272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 305/620] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:42 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:43.701561 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:43.702452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:43.763460 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:43.764142 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:43.767276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:43.772567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:43.773055 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:43.773872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:43.774312 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:43.888739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:43.889445 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:43.891520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:43.897281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:43.897860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:43.898703 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:43.899257 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:43.913853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:43.920568 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:43.922078 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:43.923272 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cc0c7e14-66e4-43b4-b4e0-5fe1bbbea682 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.222626 Jun 24 15:23:43.923849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 316/621] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:43 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:44.042134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:44.050038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6145d56a-f2b8-48f9-a9de-8d486372d400 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.165167 Jun 24 15:23:44.051234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 306/622] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:43 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:44.941936 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:44.942536 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:44.950070 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:44.950515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:44.951297 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:44.951730 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:45.067987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:45.069331 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:45.075737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:45.076194 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:45.076975 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:45.077414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:45.080436 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:45.096450 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:45.098254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:45.099464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-315ce45c-6e0c-4e1f-b9fc-ef789d1ec6d9 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.161625 Jun 24 15:23:45.100018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 317/623] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:44 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:45.220099 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:45.228117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bf5ede18-5a0c-4f6b-9f81-de3dc88b14e1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.164072 Jun 24 15:23:45.228673 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 307/624] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:45 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:46.117880 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:46.121017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:46.125129 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:46.125579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:46.126345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:46.126785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:46.245519 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:46.246189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:46.258796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:46.258954 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:46.258954 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:46.258954 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:46.258954 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:46.262174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:46.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:46.264769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-135a037c-2d25-4a81-bf0c-dcfe06d29e3e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.151152 Jun 24 15:23:46.265322 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 318/625] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:46 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:46.399947 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:46.408151 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ced6688a-899f-493f-855a-56cc3bdfe5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.166476 Jun 24 15:23:46.408749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 308/626] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:46 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:47.283297 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:47.283840 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:47.291096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:47.291590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:47.292388 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:47.292828 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:47.420830 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:47.425752 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:47.426403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:47.429659 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:47.431165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:47.432297 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1cbc518a-206a-4de2-99a0-640a1ee587e2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.153172 Jun 24 15:23:47.432858 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 319/627] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:47 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:47.433255 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:47.433706 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:47.434473 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:47.434908 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:47.575612 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:47.583415 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-49288395-36cf-4dd2-b9b4-dd5dfe7bacef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.161536 Jun 24 15:23:47.584596 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 309/628] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:47 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:48.450547 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:48.451278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:48.457708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:48.458143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:48.458966 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:48.459425 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:48.591897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:48.600096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:48.601114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:48.601560 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:48.601882 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:48.602626 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e494499c-55b1-482b-a004-2ddedacf2851 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.156119 Jun 24 15:23:48.603779 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 320/629] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:48 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:48.605510 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:48.609220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:48.612147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:48.612147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:48.612147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:48.759633 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:48.767590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d872636c-bced-4882-bf53-fb68ce2f53a9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.170301 Jun 24 15:23:48.768147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 310/630] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:48 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:49.117379 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-a6f99ce5-1b22-4038-84fd-0ccb40235d1f req-d2156174-60e7-4503-8724-ef0ee70c6ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffef349a-ea09-44f9-9cd1-cf5d9b905e50", "name": "network-vif-plugged", "status": "completed", "tag": "98f0ee1c-7936-46ad-937e-8e43f17d155f"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:49.125313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a6f99ce5-1b22-4038-84fd-0ccb40235d1f req-d2156174-60e7-4503-8724-ef0ee70c6ee5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:49.125767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a6f99ce5-1b22-4038-84fd-0ccb40235d1f req-d2156174-60e7-4503-8724-ef0ee70c6ee5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:49.137035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-a6f99ce5-1b22-4038-84fd-0ccb40235d1f req-d2156174-60e7-4503-8724-ef0ee70c6ee5 service nova] Creating event network-vif-plugged:98f0ee1c-7936-46ad-937e-8e43f17d155f for instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 on hv-cinder-83538 Jun 24 15:23:49.142011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-a6f99ce5-1b22-4038-84fd-0ccb40235d1f req-d2156174-60e7-4503-8724-ef0ee70c6ee5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028858 Jun 24 15:23:49.142579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 321/631] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:49.621151 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:49.621758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:49.628698 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:49.629723 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:49.630001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:49.630497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:49.770545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:49.779483 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:49.787548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:49.787548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d79f20b3-fdcb-4969-8759-38fe29487dc4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.164930 Jun 24 15:23:49.787548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 311/632] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:49 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:49.787937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:49.787937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:49.797173 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:49.797622 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:49.798425 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:49.798861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:49.941974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:49.949890 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-240294ad-1629-4ef9-b2b8-6ef48ffaa6b1 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.168274 Jun 24 15:23:49.950464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 322/633] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:49 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:50.801667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:50.802809 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:50.809327 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:50.809774 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:50.812956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:50.812956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:50.945150 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:50.953043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:50.954588 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:50.955726 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-78a7db29-798e-47b1-ab97-1235c04077f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1407 microversion: 2.20 time: 0.158676 Jun 24 15:23:50.956285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 312/634] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:50 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:50.967152 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:50.967830 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:50.974876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:50.977393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:50.977393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:50.977393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:51.122622 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:51.130824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-17b6b342-fc1f-435f-9348-d1adf309f001 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.167657 Jun 24 15:23:51.131480 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 323/635] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:50 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:51.973199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:51.973804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:51.980461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:51.980907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:51.981665 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:51.982102 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:52.113004 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:52.121575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:52.123054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:52.124205 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7952f1ea-d037-41df-a7c4-6504f177b68d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1600 microversion: 2.20 time: 0.154904 Jun 24 15:23:52.124783 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 313/636] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:23:51 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:23:52.142607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-88145765-1528-423c-8f4e-917502bd93fb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:52.143116 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-88145765-1528-423c-8f4e-917502bd93fb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:52.147686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:52.148244 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:52.149750 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88145765-1528-423c-8f4e-917502bd93fb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:52.150199 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88145765-1528-423c-8f4e-917502bd93fb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:52.151251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88145765-1528-423c-8f4e-917502bd93fb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:52.151690 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-88145765-1528-423c-8f4e-917502bd93fb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:52.154597 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:52.155049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:52.155861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:52.156300 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:52.260453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-88145765-1528-423c-8f4e-917502bd93fb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.121790 Jun 24 15:23:52.261350 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 324/637] 10.222.0.67 () {60 vars in 1315 bytes} [Fri Jun 24 15:23:52 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:23:52.448679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:52.456681 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-972e8ac2-c7ba-4f39-8ec4-93159eca60e9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.313135 Jun 24 15:23:52.457331 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 314/638] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:52 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:23:53.303749 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-1bb2e60a-c600-4888-a762-2241058aa680 req-8c38dd56-c540-4866-848a-b0ccfbe67eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffef349a-ea09-44f9-9cd1-cf5d9b905e50", "tag": "98f0ee1c-7936-46ad-937e-8e43f17d155f"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:23:53.311978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1bb2e60a-c600-4888-a762-2241058aa680 req-8c38dd56-c540-4866-848a-b0ccfbe67eab service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:53.312423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1bb2e60a-c600-4888-a762-2241058aa680 req-8c38dd56-c540-4866-848a-b0ccfbe67eab service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:53.324444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-1bb2e60a-c600-4888-a762-2241058aa680 req-8c38dd56-c540-4866-848a-b0ccfbe67eab service nova] Creating event network-changed:98f0ee1c-7936-46ad-937e-8e43f17d155f for instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 on hv-cinder-83538 Jun 24 15:23:53.329216 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-1bb2e60a-c600-4888-a762-2241058aa680 req-8c38dd56-c540-4866-848a-b0ccfbe67eab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029808 Jun 24 15:23:53.329787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 325/639] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:23:53.474889 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:53.475785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:53.482393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:53.483093 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:53.484079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:53.484664 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:53.639464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:53.648290 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3da200d2-b0a4-49a0-800f-ead7c57dd034 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.178167 Jun 24 15:23:53.649125 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 315/640] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:53 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:54.667144 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:54.667883 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:54.674890 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:54.675373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:54.676141 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:54.676573 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:54.679933 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:54.821948 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:54.829964 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3cbd2520-f92b-47d9-87ab-fa5c34b3c6ef tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.167536 Jun 24 15:23:54.830537 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 326/641] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:54 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:55.846992 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:55.847616 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:55.854627 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:55.855078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:55.855875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:55.856315 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:55.858853 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:56.001339 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:56.009864 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-05e6329b-0e4d-4e01-84ec-03ebf5fe2ac2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.166705 Jun 24 15:23:56.010424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 316/642] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:55 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:57.026905 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:57.027539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:57.033977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:57.034420 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:57.035190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:57.035628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:57.178214 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:57.186368 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-359cf4bf-b6e2-4787-a38e-90a84fae5347 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.164436 Jun 24 15:23:57.186925 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 327/643] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:57 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:58.204012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:58.204615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:58.211145 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:58.212116 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:58.212871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:58.213305 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:58.354345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:58.362400 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7f3dc3f5-e5f0-48eb-b5e3-af45644adaa4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.162223 Jun 24 15:23:58.362967 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 317/644] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:58 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:23:59.379815 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:23:59.380473 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:23:59.387704 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:59.388287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:59.389171 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:23:59.389662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:23:59.539543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:23:59.548097 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5fc5563a-d75e-4eba-ad83-ac75ccceb794 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.172137 Jun 24 15:23:59.551212 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 328/645] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:23:59 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:00.564840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:00.565442 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:00.572198 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:00.572705 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:00.578393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:00.578393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:00.722461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:00.730973 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e21b08a2-5bf4-44c0-a43b-7a5a7aaf3103 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.169914 Jun 24 15:24:00.731624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 318/646] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:00 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:01.750210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:01.750839 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:01.757194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:01.757640 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:01.759361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:01.759984 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:01.941023 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:01.950773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a798ecdf-655d-4f98-a90d-d3ef6ebc6600 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.205851 Jun 24 15:24:01.951429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 329/647] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:01 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:02.968453 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:02.969060 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:02.976923 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:02.977855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:02.978622 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:02.979266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:03.444580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:03.453507 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bfe3ad8b-ed2c-4e1a-b7f4-d13127b65ea2 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.489024 Jun 24 15:24:03.454073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 319/648] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:02 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:04.470996 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:04.472355 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:04.480394 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:04.481123 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:04.482311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:04.483636 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:04.726400 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:04.743772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-46b6ee81-4e0d-47c1-aecb-c66de48b63c9 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1754 microversion: 2.1 time: 0.275648 Jun 24 15:24:04.744571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 330/649] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:04 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1754 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:05.762355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:05.763065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:05.771036 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:05.771616 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:05.772398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:05.772835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:06.036242 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:06.047670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2daecaa8-4280-4114-9e3c-1226df4d1d93 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1757 microversion: 2.1 time: 0.290299 Jun 24 15:24:06.053912 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 320/650] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:05 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1757 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:07.163968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:07.165879 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:07.184423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:07.184423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:07.184423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:07.184423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:07.261599 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lazy-loading 'services' on Instance uuid 68a388fa-baf9-475a-9e9e-4b89f267983d {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:24:07.434144 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-df40e10a-9a9a-423b-af5d-03a0a046c805 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "DELETE /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments/c23ce3cc-da07-4389-99ed-94603aaef119" status: 202 len: 0 microversion: 2.1 time: 0.273875 Jun 24 15:24:07.435359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 331/651] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:24:07 2022] DELETE /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments/c23ce3cc-da07-4389-99ed-94603aaef119 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:24:07.443531 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6400de2e-f59e-406d-b1bd-0e91ff2d8c6e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:07.444572 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6400de2e-f59e-406d-b1bd-0e91ff2d8c6e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:07.452480 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6400de2e-f59e-406d-b1bd-0e91ff2d8c6e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:07.453428 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6400de2e-f59e-406d-b1bd-0e91ff2d8c6e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:07.454055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6400de2e-f59e-406d-b1bd-0e91ff2d8c6e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:07.454578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6400de2e-f59e-406d-b1bd-0e91ff2d8c6e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:07.485084 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6400de2e-f59e-406d-b1bd-0e91ff2d8c6e tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045611 Jun 24 15:24:07.485645 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 321/652] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:24:07 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:24:08.498311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-97e8414a-810b-4ffe-afb9-822e81ac47d7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:08.500235 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-97e8414a-810b-4ffe-afb9-822e81ac47d7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:08.513756 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97e8414a-810b-4ffe-afb9-822e81ac47d7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:08.514214 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97e8414a-810b-4ffe-afb9-822e81ac47d7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:08.515050 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97e8414a-810b-4ffe-afb9-822e81ac47d7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:08.515504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97e8414a-810b-4ffe-afb9-822e81ac47d7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:08.549486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-97e8414a-810b-4ffe-afb9-822e81ac47d7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055635 Jun 24 15:24:08.553326 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 332/653] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:24:08 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:09.562082 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2f05704f-e7b1-4f13-8034-bac0b5b1da06 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:09.563148 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2f05704f-e7b1-4f13-8034-bac0b5b1da06 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:09.570163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f05704f-e7b1-4f13-8034-bac0b5b1da06 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:09.571406 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f05704f-e7b1-4f13-8034-bac0b5b1da06 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:09.572537 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f05704f-e7b1-4f13-8034-bac0b5b1da06 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:09.573362 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2f05704f-e7b1-4f13-8034-bac0b5b1da06 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:09.605651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2f05704f-e7b1-4f13-8034-bac0b5b1da06 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047824 Jun 24 15:24:09.606388 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 322/654] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:24:09 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:24:09.692868 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:09.693453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:09.702799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:09.703334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:09.704113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:09.704551 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:09.735810 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:24:10.105427 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0a16561a-1a05-4067-aa3c-3b86815e5cf5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "DELETE /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 204 len: 0 microversion: 2.1 time: 0.416991 Jun 24 15:24:10.106584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 333/655] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:24:09 2022] DELETE /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 15:24:10.116191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:10.116839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:10.130148 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:10.131574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:10.135321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:10.135321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:10.580817 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:10.583029 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-040b0e8a-a825-40f7-a0d4-9361d0634ce5 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1688 microversion: 2.1 time: 0.472626 Jun 24 15:24:10.583644 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 323/656] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:10 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1688 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:11.601451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:11.602908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:11.609360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:11.610842 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:11.610842 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:11.611053 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:11.826505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:11.834447 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3b054cee-c15a-456a-83cf-cacfc74e6981 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1688 microversion: 2.1 time: 0.237123 Jun 24 15:24:11.835316 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 334/657] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:11 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1688 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:12.852808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:12.853435 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:12.861097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:12.861658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:12.862553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:12.863018 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:13.007684 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:13.017994 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7378e6d7-1772-4c21-acee-7103cd835f9c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1688 microversion: 2.1 time: 0.168677 Jun 24 15:24:13.019161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 324/658] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:12 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:13.100485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-952fe7b0-febb-4331-a3fe-7681d5fabf0a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Action: 'create', calling method: .version_select at 0x7f18b28c3430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2031902843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg4ukwmuf+yQmlFblyMC7lCpAykrMG2Jx3B76n3HIdQnV/QWkx/+XaTgn0e0dvcyTek+XoPj53s48S+y+74rIzcdBnA3+GOaoFwm2UnUFbMyCCdJUpoyb/Sd4AjLLVFHg=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:13.118699 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-952fe7b0-febb-4331-a3fe-7681d5fabf0a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for project 06aac4c0b410452fa71221434149e3b7. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:24:13.122500 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-952fe7b0-febb-4331-a3fe-7681d5fabf0a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for user 6f9c73ca3c364117993dac93acf5a737 and project 06aac4c0b410452fa71221434149e3b7. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:24:13.243944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-952fe7b0-febb-4331-a3fe-7681d5fabf0a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.328546 Jun 24 15:24:13.244555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 335/659] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:24:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:14.035918 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:14.037308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:14.047042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:14.047808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:14.049047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:14.049777 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:14.234268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:14.242165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c6686bd0-189e-456f-a0fb-5f62b0dda99c tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1688 microversion: 2.1 time: 0.211282 Jun 24 15:24:14.242825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 325/660] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:14 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:14.835610 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-9c2155a9-9c9b-4a50-8327-3cf7744bd538 req-2e088985-81d9-4d43-acf1-a3ea9ccced99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a388fa-baf9-475a-9e9e-4b89f267983d", "name": "network-vif-deleted", "tag": "f136a5f8-c1cb-48a1-8b07-9b685830d3b5"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:14.853212 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-9c2155a9-9c9b-4a50-8327-3cf7744bd538 req-2e088985-81d9-4d43-acf1-a3ea9ccced99 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:14.854429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-9c2155a9-9c9b-4a50-8327-3cf7744bd538 req-2e088985-81d9-4d43-acf1-a3ea9ccced99 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:14.867283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-9c2155a9-9c9b-4a50-8327-3cf7744bd538 req-2e088985-81d9-4d43-acf1-a3ea9ccced99 service nova] Creating event network-vif-deleted:f136a5f8-c1cb-48a1-8b07-9b685830d3b5 for instance 68a388fa-baf9-475a-9e9e-4b89f267983d on hv-cinder-83538 Jun 24 15:24:14.874228 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-9c2155a9-9c9b-4a50-8327-3cf7744bd538 req-2e088985-81d9-4d43-acf1-a3ea9ccced99 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132677 Jun 24 15:24:14.875459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 336/661] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:15.268719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:15.271271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:15.284773 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:15.285236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:15.287316 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:15.287769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:15.338447 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:15.339318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:15.340760 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lazy-loading 'fault' on Instance uuid 68a388fa-baf9-475a-9e9e-4b89f267983d {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:24:15.401326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:15.411893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-686f8d0b-02d1-4cd3-9193-cd40ea4a7ff6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 200 len: 1334 microversion: 2.1 time: 0.147232 Jun 24 15:24:15.424097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 326/662] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:15 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 1334 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:16.430660 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:16.431466 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 68a388fa-baf9-475a-9e9e-4b89f267983d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:16.433501 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:16.441104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:16.450947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:16.450947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:16.450947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:16.460724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] HTTP exception thrown: Instance 68a388fa-baf9-475a-9e9e-4b89f267983d could not be found. Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Request method failure captured: Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d HTTP/1.1 Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXTm1kZ83vG0dVn9_eQU34jeaIS5Xs1kwFIHFrRcoFU5BwqAOFrPmil7zy7R1kti-JyFTcOryxCr-ifJqmjVaccKZqUW0NzOwvA6tjKh9i2VEhxAP-ir2UKSYsaLi_a3l93CWfiWHhabKVeTmWfW4WjSkhckXMByI88sL4WOnXU9pM Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:24:16.462957 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6bf0e1123fa47a7844e09127fb16d6e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: b67761f9b13340a090efc1cb07714912 Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 68a388fa-baf9-475a-9e9e-4b89f267983d could not be found. Jun 24 15:24:16.464617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '68a388fa-baf9-475a-9e9e-4b89f267983d'} Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68a388fa-baf9-475a-9e9e-4b89f267983d could not be found. Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:24:16.465528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68a388fa-baf9-475a-9e9e-4b89f267983d could not be found. Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68a388fa-baf9-475a-9e9e-4b89f267983d could not be found. Jun 24 15:24:16.466797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:16.467949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Returning 404 to user: Instance 68a388fa-baf9-475a-9e9e-4b89f267983d could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:24:16.467949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ff4a2ce4-28fa-477e-b56a-192bd098fcbb tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d" status: 404 len: 111 microversion: 2.1 time: 0.039073 Jun 24 15:24:16.467949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 337/663] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:16 2022] GET /compute/v2.1/servers/68a388fa-baf9-475a-9e9e-4b89f267983d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:24:16.474572 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-79ec9040-a64a-4903-bddc-f0da0044377f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '.version_select at 0x7f18b203f5e0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:16.569578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-79ec9040-a64a-4903-bddc-f0da0044377f tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133571778" status: 202 len: 0 microversion: 2.1 time: 0.098806 Jun 24 15:24:16.572178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 327/664] 10.222.0.67 () {58 vars in 1217 bytes} [Fri Jun 24 15:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133571778 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:24:19.919649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:19.920147 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:19.926820 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:19.927295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:19.928063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:19.928504 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:19.957550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:24:20.253329 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-72752bec-3449-483f-a3db-b875140f0d61 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 204 len: 0 microversion: 2.1 time: 0.337553 Jun 24 15:24:20.253918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 338/665] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:24:19 2022] DELETE /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:24:20.263039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:20.263678 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:20.265637 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:20.271049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:20.271521 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:20.272342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:20.272776 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:20.403091 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:20.410628 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-472f6181-28d5-4a20-839c-85e814c16c87 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1508 microversion: 2.1 time: 0.152188 Jun 24 15:24:20.411238 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 328/666] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:20 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:21.428768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:21.429802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:21.437061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:21.437577 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:21.438404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:21.438844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:21.579576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:21.587722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9e6cfa6e-e363-48f5-85aa-5fcd99b33ef9 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1508 microversion: 2.1 time: 0.163246 Jun 24 15:24:21.588284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 339/667] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:21 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:22.605141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:22.605733 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:22.612470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:22.612919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:22.613690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:22.614131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:22.750704 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:22.758519 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-872fcaa9-2c53-417d-9884-96eed51f0279 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1508 microversion: 2.1 time: 0.157744 Jun 24 15:24:22.759143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 329/668] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:22 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:22.902320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-6cb5dd39-925b-4d94-bfe3-2e1e4adbaad0 req-e50cb286-6bcc-4987-a1c1-0e218e826feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a390f9-db97-4a41-a7df-e71f3d5c9ceb", "name": "network-vif-deleted", "tag": "8cf89439-cc2e-4f42-bff5-bf72f779218b"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:22.913016 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-6cb5dd39-925b-4d94-bfe3-2e1e4adbaad0 req-e50cb286-6bcc-4987-a1c1-0e218e826feb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:22.913489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-6cb5dd39-925b-4d94-bfe3-2e1e4adbaad0 req-e50cb286-6bcc-4987-a1c1-0e218e826feb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:22.924999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-6cb5dd39-925b-4d94-bfe3-2e1e4adbaad0 req-e50cb286-6bcc-4987-a1c1-0e218e826feb service nova] Creating event network-vif-deleted:8cf89439-cc2e-4f42-bff5-bf72f779218b for instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb on hv-cinder-83538 Jun 24 15:24:22.929929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-6cb5dd39-925b-4d94-bfe3-2e1e4adbaad0 req-e50cb286-6bcc-4987-a1c1-0e218e826feb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037939 Jun 24 15:24:22.931335 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 340/669] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:23.776933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:23.777528 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:23.784082 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:23.784571 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:23.785507 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:23.786098 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:23.815937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:23.816381 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:23.816818 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lazy-loading 'fault' on Instance uuid d1a390f9-db97-4a41-a7df-e71f3d5c9ceb {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:24:23.862768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:23.870647 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3966ad07-27a5-49ab-baf2-02b653c210e8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 200 len: 1312 microversion: 2.1 time: 0.098877 Jun 24 15:24:23.871225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 330/670] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:23 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:24.885626 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=4 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:24.890483 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:24.891206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: d1a390f9-db97-4a41-a7df-e71f3d5c9ceb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:24.897316 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:24.897765 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:24.899022 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:24.899479 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:24.903621 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:24.912652 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] HTTP exception thrown: Instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb could not be found. Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Request method failure captured: Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb HTTP/1.1 Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXTm1kZ83vG0dVn9_eQU34jeaIS5Xs1kwFIHFrRcoFU5BwqAOFrPmil7zy7R1kti-JyFTcOryxCr-ifJqmjVaccKZqUW0NzOwvA6tjKh9i2VEhxAP-ir2UKSYsaLi_a3l93CWfiWHhabKVeTmWfW4WjSkhckXMByI88sL4WOnXU9pM Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:24:24.914844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6bf0e1123fa47a7844e09127fb16d6e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: b67761f9b13340a090efc1cb07714912 Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb could not be found. Jun 24 15:24:24.919662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'd1a390f9-db97-4a41-a7df-e71f3d5c9ceb'} Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb could not be found. Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:24:24.921064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb could not be found. Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb could not be found. Jun 24 15:24:24.922518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:24.923860 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Returning 404 to user: Instance d1a390f9-db97-4a41-a7df-e71f3d5c9ceb could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:24:24.923860 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e700b40c-9af9-4bcb-ad62-5d562eb12ae6 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb" status: 404 len: 111 microversion: 2.1 time: 0.031627 Jun 24 15:24:24.923860 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 341/671] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:24 2022] GET /compute/v2.1/servers/d1a390f9-db97-4a41-a7df-e71f3d5c9ceb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:24:24.925014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:24.925509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:24.932051 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:24.932499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:24.933250 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:24.933679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:24.959768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:24:25.080362 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:25.284935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-43e574bb-bc78-4641-9b5d-3d171b4733bd tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "DELETE /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 204 len: 0 microversion: 2.1 time: 0.363462 Jun 24 15:24:25.285547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 331/672] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:24:24 2022] DELETE /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:24:25.294377 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:25.294982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:25.302006 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:25.302474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:25.303258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:25.303691 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:25.440876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:25.449474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e901942e-af9c-428f-add0-dca7df337326 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.159574 Jun 24 15:24:25.450043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 342/673] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:25 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:26.468674 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:26.469399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:26.475967 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:26.477033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:26.477795 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:26.478231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:26.612188 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:26.620623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f06920bd-a985-42eb-aacf-fc739e30d0c0 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.156150 Jun 24 15:24:26.621178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 332/674] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:26 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:27.637763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:27.638361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:27.644857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:27.645300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:27.646049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:27.646511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:27.791094 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:27.798445 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-71d71884-d332-4d5c-b493-f279e42d82f8 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1522 microversion: 2.1 time: 0.164484 Jun 24 15:24:27.799137 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 343/675] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:27 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:28.235826 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-ec07587f-e6f1-4275-9255-81a294f08127 req-9f8c970d-5ad9-4e29-98fe-d049d28dce47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72dcf091-51b8-4200-86d7-002dde49e07c", "name": "network-vif-deleted", "tag": "cdb31b17-1cea-4ead-bfa9-8e2eaf5beea8"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:28.244549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-ec07587f-e6f1-4275-9255-81a294f08127 req-9f8c970d-5ad9-4e29-98fe-d049d28dce47 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:28.249267 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-ec07587f-e6f1-4275-9255-81a294f08127 req-9f8c970d-5ad9-4e29-98fe-d049d28dce47 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:28.258557 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-ec07587f-e6f1-4275-9255-81a294f08127 req-9f8c970d-5ad9-4e29-98fe-d049d28dce47 service nova] Creating event network-vif-deleted:cdb31b17-1cea-4ead-bfa9-8e2eaf5beea8 for instance 72dcf091-51b8-4200-86d7-002dde49e07c on hv-cinder-83538 Jun 24 15:24:28.263416 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-ec07587f-e6f1-4275-9255-81a294f08127 req-9f8c970d-5ad9-4e29-98fe-d049d28dce47 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031324 Jun 24 15:24:28.264023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 333/676] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:28.815844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:28.816352 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:28.823209 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:28.823668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:28.824435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:28.824885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:28.858312 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:28.858760 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:28.859223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lazy-loading 'fault' on Instance uuid 72dcf091-51b8-4200-86d7-002dde49e07c {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:24:28.903399 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67761f9b13340a090efc1cb07714912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6bf0e1123fa47a7844e09127fb16d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:28.910906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-671d2ba9-b1b9-41b6-b13e-06c208d141fc tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 200 len: 1312 microversion: 2.1 time: 0.099123 Jun 24 15:24:28.911498 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 344/677] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:28 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:29.928561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:29.929321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] [instance: 72dcf091-51b8-4200-86d7-002dde49e07c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:29.936138 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:29.936590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:29.937352 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:29.937792 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:29.950652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] HTTP exception thrown: Instance 72dcf091-51b8-4200-86d7-002dde49e07c could not be found. Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Request method failure captured: Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c HTTP/1.1 Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXTm1kZ83vG0dVn9_eQU34jeaIS5Xs1kwFIHFrRcoFU5BwqAOFrPmil7zy7R1kti-JyFTcOryxCr-ifJqmjVaccKZqUW0NzOwvA6tjKh9i2VEhxAP-ir2UKSYsaLi_a3l93CWfiWHhabKVeTmWfW4WjSkhckXMByI88sL4WOnXU9pM Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:24:29.952274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b6bf0e1123fa47a7844e09127fb16d6e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b6bf0e1123fa47a7844e09127fb16d6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: b6bf0e1123fa47a7844e09127fb16d6e Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1475780933 Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: b67761f9b13340a090efc1cb07714912 Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1475780933-project Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance 72dcf091-51b8-4200-86d7-002dde49e07c could not be found. Jun 24 15:24:29.953894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '72dcf091-51b8-4200-86d7-002dde49e07c'} Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72dcf091-51b8-4200-86d7-002dde49e07c could not be found. Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:24:29.954764 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72dcf091-51b8-4200-86d7-002dde49e07c could not be found. Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72dcf091-51b8-4200-86d7-002dde49e07c could not be found. Jun 24 15:24:29.956225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:24:29.957498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] Returning 404 to user: Instance 72dcf091-51b8-4200-86d7-002dde49e07c could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:24:29.957498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4e3c433e-4a05-4d55-8388-1c7f067496f7 tempest-ServerRescueNegativeTestJSON-1475780933 tempest-ServerRescueNegativeTestJSON-1475780933-project] 10.222.0.67 "GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c" status: 404 len: 111 microversion: 2.1 time: 0.029771 Jun 24 15:24:29.957498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 334/678] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:29 2022] GET /compute/v2.1/servers/72dcf091-51b8-4200-86d7-002dde49e07c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:24:32.866307 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1429043095", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2031902843", "security_groups": [{"name": "tempest-secgroup-smoke-313335785"}], "block_device_mapping_v2": [{"uuid": "7e57e03d-5aaf-4b27-b950-a3c3abae400d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a32a679-de41-498c-bfd0-5831dd67fdee"}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:32.978744 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] validate_networks() for [('2a32a679-de41-498c-bfd0-5831dd67fdee', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:24:33.484929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:24:33.487767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:24:33.488480 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:24:33.489642 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:24:33.490147 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:24:33.500844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:33.501633 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:33.502625 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:33.503283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:33.521584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for project 06aac4c0b410452fa71221434149e3b7. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:24:33.526781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for user 6f9c73ca3c364117993dac93acf5a737 and project 06aac4c0b410452fa71221434149e3b7. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:24:33.587047 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:24:33.589329 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e57e03d-5aaf-4b27-b950-a3c3abae400d',volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:24:34.029476 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d11efcb8-71d9-4c04-af56-9dce815a5a5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.167010 Jun 24 15:24:34.034949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 345/679] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:24:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:24:34.041269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dd362320-c264-4c3e-a45a-e5c6f5918579 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:34.041965 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dd362320-c264-4c3e-a45a-e5c6f5918579 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:34.099599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dd362320-c264-4c3e-a45a-e5c6f5918579 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:34.106903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dd362320-c264-4c3e-a45a-e5c6f5918579 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1095 microversion: 2.1 time: 0.070352 Jun 24 15:24:34.107821 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 335/680] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:34 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:35.124251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:35.125531 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:35.133175 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:35.139380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:35.139380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:35.139380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:35.208773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:35.217584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ee81787-df7b-499d-b446-c260eed9942d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1145 microversion: 2.1 time: 0.097894 Jun 24 15:24:35.218154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 346/681] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:35 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:36.242210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:36.242210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:36.246926 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:36.247482 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:36.248409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:36.248904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:36.318847 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:36.326857 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-91fd6399-a965-4f34-8f2d-6d389dfdd793 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1193 microversion: 2.1 time: 0.092161 Jun 24 15:24:36.327460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 336/682] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:36 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:37.012222 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8321c744-daaa-499c-b4d5-59bf636cf3c3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:37.012821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8321c744-daaa-499c-b4d5-59bf636cf3c3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:37.019790 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8321c744-daaa-499c-b4d5-59bf636cf3c3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:37.020556 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8321c744-daaa-499c-b4d5-59bf636cf3c3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:37.021406 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8321c744-daaa-499c-b4d5-59bf636cf3c3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:37.022034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8321c744-daaa-499c-b4d5-59bf636cf3c3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:37.047787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8321c744-daaa-499c-b4d5-59bf636cf3c3 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/ips" status: 200 len: 153 microversion: 2.20 time: 0.039781 Jun 24 15:24:37.048356 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 347/683] 10.222.0.67 () {60 vars in 1288 bytes} [Fri Jun 24 15:24:37 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 15:24:37.344990 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:37.346216 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:37.353143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:37.353589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:37.354355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:37.354784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:37.541686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:37.550800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-37ea755d-e25c-4f92-8c2f-fa9ddc6d95ef tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1278 microversion: 2.1 time: 0.210279 Jun 24 15:24:37.551421 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 337/684] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:37 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:38.440556 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-2b86baa0-8187-4ca5-bb8d-d5e727af6d65 req-787747b6-d79c-4e05-a701-04932e6522f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc17ccb-c0b1-4819-9051-e715458f4529", "tag": "e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:38.457974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-2b86baa0-8187-4ca5-bb8d-d5e727af6d65 req-787747b6-d79c-4e05-a701-04932e6522f6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:38.458448 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-2b86baa0-8187-4ca5-bb8d-d5e727af6d65 req-787747b6-d79c-4e05-a701-04932e6522f6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:38.471471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-2b86baa0-8187-4ca5-bb8d-d5e727af6d65 req-787747b6-d79c-4e05-a701-04932e6522f6 service nova] Creating event network-changed:e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc for instance dcc17ccb-c0b1-4819-9051-e715458f4529 on hv-cinder-83538 Jun 24 15:24:38.477133 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-2b86baa0-8187-4ca5-bb8d-d5e727af6d65 req-787747b6-d79c-4e05-a701-04932e6522f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047235 Jun 24 15:24:38.477736 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 348/685] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:38.568537 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:38.569520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:38.577896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:38.577896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:38.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:38.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:38.791089 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:38.798928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e8cfe2df-9c64-40c1-826c-eb1822ce2abf tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.234297 Jun 24 15:24:38.799539 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 338/686] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:38 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:39.273408 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:39.274126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:39.280559 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:39.280990 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:39.281782 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:39.282209 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:39.305249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lazy-loading 'flavor' on Instance uuid ffef349a-ea09-44f9-9cd1-cf5d9b905e50 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:24:39.816056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:39.816663 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:39.824134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:39.824588 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:39.825360 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:39.825799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:39.834950 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-06920fe5-59a9-40dd-a598-1b9219117433 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/action" status: 202 len: 0 microversion: 2.20 time: 0.565661 Jun 24 15:24:39.839141 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 349/687] 10.222.0.67 () {62 vars in 1318 bytes} [Fri Jun 24 15:24:39 2022] POST /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:24:39.845328 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:39.846052 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:39.853397 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:39.855605 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:39.856600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:39.857049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:40.030424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:40.039021 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ee94b8da-19eb-4c41-ab85-62e79ada2bba tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.226843 Jun 24 15:24:40.039813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 339/688] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:39 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:40.058206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:40.066250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:40.067714 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:40.068870 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ea26096c-7093-4f39-963b-4d90a59a46d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.228102 Jun 24 15:24:40.069424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 350/689] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:39 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:41.056785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:41.058152 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:41.065564 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:41.066251 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:41.067197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:41.067741 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:41.089814 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:41.091818 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:41.109667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:41.122653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:41.123784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:41.124387 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:41.299731 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:41.308580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0ffb3e0d-10cc-4151-afd8-725bf5963174 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.256175 Jun 24 15:24:41.317665 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 340/690] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:41 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:41.333059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:41.342974 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:41.345375 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:41.346480 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9a931afa-b5e2-4b33-beae-9baddb7b01b7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.262169 Jun 24 15:24:41.358193 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 351/691] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:41 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:42.325852 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:42.326535 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:42.333011 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:42.335879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:42.335879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:42.335879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:42.365333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:42.365955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:42.378686 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:42.379317 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:42.380167 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:42.380676 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:42.535291 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:42.544187 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3cd7b0db-9c02-4889-8d68-6cf30d43c0d7 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.222061 Jun 24 15:24:42.545016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 341/692] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:42 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:42.563161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:42.572198 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:42.573708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:42.574870 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8cb61f71-347e-499f-b0e5-9994ef18a2c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.213441 Jun 24 15:24:42.575458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 352/693] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:42 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:24:43.561182 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:43.564461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:43.568212 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:43.568658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:43.569408 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:43.569838 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:43.593372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:43.593978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:43.596485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:43.598969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:43.602283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:43.602761 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:43.603734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:43.604176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:43.773736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:43.782600 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-575b83bf-e277-445c-8945-5edf267e08af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.225162 Jun 24 15:24:43.783456 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 342/694] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:43 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:43.788640 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:43.797139 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:43.798628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:43.799952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0b84f9d9-6474-423f-9342-b4d948ee983d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.210457 Jun 24 15:24:43.800671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 353/695] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:43 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:24:44.799325 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:44.800040 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:44.802161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:44.808074 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:44.808527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:44.812470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:44.812470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:44.818594 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:44.819228 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:44.826393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:44.826842 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:44.827663 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:44.828166 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:45.021016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:45.027645 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:45.032652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-43e70fac-385e-41f3-8138-4dd76d559b24 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.236328 Jun 24 15:24:45.032652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 343/696] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:44 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:45.037413 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-450804945"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:45.038302 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:45.043943 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:45.045957 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:45.046118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:45.046411 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:45.047398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-11402fd5-6a4d-48b0-8a22-d7beb9ca21b2 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.233611 Jun 24 15:24:45.053093 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:45.053234 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 354/697] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:44 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:24:45.053350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:45.185329 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.network.security_group_api [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Removing security group 6502aab0-e136-43d0-949d-b9bd8e471beb from port 18c7a045-91ca-44b2-abe0-c90523b83549 Jun 24 15:24:45.589636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8fe656b-c567-4436-bca7-65e104349864 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/action" status: 202 len: 0 microversion: 2.1 time: 0.555741 Jun 24 15:24:45.593732 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 344/698] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:24:45 2022] POST /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:24:45.778497 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-e70e551c-a545-434c-afe6-374e4bbc8c60 req-cd4de621-491d-409b-abf9-0ab61cfa0e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b13f6b-a027-4371-8012-54f025a726fa", "tag": "18c7a045-91ca-44b2-abe0-c90523b83549"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:45.791786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e70e551c-a545-434c-afe6-374e4bbc8c60 req-cd4de621-491d-409b-abf9-0ab61cfa0e19 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:45.792618 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e70e551c-a545-434c-afe6-374e4bbc8c60 req-cd4de621-491d-409b-abf9-0ab61cfa0e19 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:45.809585 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-e70e551c-a545-434c-afe6-374e4bbc8c60 req-cd4de621-491d-409b-abf9-0ab61cfa0e19 service nova] Creating event network-changed:18c7a045-91ca-44b2-abe0-c90523b83549 for instance 79b13f6b-a027-4371-8012-54f025a726fa on hv-cinder-83538 Jun 24 15:24:45.815013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-e70e551c-a545-434c-afe6-374e4bbc8c60 req-cd4de621-491d-409b-abf9-0ab61cfa0e19 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221186 Jun 24 15:24:45.816104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 355/699] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:46.048819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:46.050757 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:46.055780 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:46.056208 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:46.056980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:46.057423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:46.072631 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:46.074214 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:46.081366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:46.081861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:46.085422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:46.085422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:46.401995 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:46.407114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:46.411679 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:46.414661 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:46.416154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-51a21ea3-d688-4959-b23b-135ac98ef448 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.349904 Jun 24 15:24:46.417378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-40a7256d-d702-48af-9e85-fc29cf1fce73 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.372996 Jun 24 15:24:46.418071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 356/700] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:46 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:46.431610 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 345/701] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:46 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:47.203686 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:47.204185 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:47.210573 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.211029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.212383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.212913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.302341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lazy-loading 'services' on Instance uuid 79b13f6b-a027-4371-8012-54f025a726fa {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:24:47.434163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:47.436774 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:47.438222 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:47.446588 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.447038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.447884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.448501 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.522768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-89f069db-4724-4e43-b607-778b7a07e775 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "DELETE /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments/739ed036-0c4c-43ab-87ec-2525ddec0b7c" status: 202 len: 0 microversion: 2.1 time: 0.322254 Jun 24 15:24:47.526889 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 357/702] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:24:47 2022] DELETE /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments/739ed036-0c4c-43ab-87ec-2525ddec0b7c => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:24:47.534087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:47.535970 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:47.548904 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.551615 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.551615 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.552233 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.669946 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:47.683016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:47.688132 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:47.689771 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7e685789-2ba0-4c31-be7e-282fe637ab47 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.258080 Jun 24 15:24:47.704098 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 346/703] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:47 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:24:47.718077 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f72657c-ec3f-4015-8cfa-2fabeb67a9e8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:47.720940 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f72657c-ec3f-4015-8cfa-2fabeb67a9e8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:47.732673 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f72657c-ec3f-4015-8cfa-2fabeb67a9e8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.735910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f72657c-ec3f-4015-8cfa-2fabeb67a9e8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.737039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f72657c-ec3f-4015-8cfa-2fabeb67a9e8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.737503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6f72657c-ec3f-4015-8cfa-2fabeb67a9e8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.770647 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:47.788401 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f72657c-ec3f-4015-8cfa-2fabeb67a9e8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081563 Jun 24 15:24:47.790447 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cbe811ab-8e9f-4c0d-ad17-30eb9136b666 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.261466 Jun 24 15:24:47.795671 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 347/704] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:24:47 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:47.795806 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 358/705] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:47 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:47.830704 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-4bd6b2c1-057c-4c2d-b400-7159c896e966 req-8175f2ca-be83-4cca-98df-d1194980fe6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b13f6b-a027-4371-8012-54f025a726fa", "tag": "18c7a045-91ca-44b2-abe0-c90523b83549"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:47.841861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4bd6b2c1-057c-4c2d-b400-7159c896e966 req-8175f2ca-be83-4cca-98df-d1194980fe6f service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:47.842306 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4bd6b2c1-057c-4c2d-b400-7159c896e966 req-8175f2ca-be83-4cca-98df-d1194980fe6f service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:47.856636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-4bd6b2c1-057c-4c2d-b400-7159c896e966 req-8175f2ca-be83-4cca-98df-d1194980fe6f service nova] Creating event network-changed:18c7a045-91ca-44b2-abe0-c90523b83549 for instance 79b13f6b-a027-4371-8012-54f025a726fa on hv-cinder-83538 Jun 24 15:24:47.861858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-4bd6b2c1-057c-4c2d-b400-7159c896e966 req-8175f2ca-be83-4cca-98df-d1194980fe6f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035568 Jun 24 15:24:47.862497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 348/706] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:24:48.717026 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:48.717638 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:48.724597 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.725046 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.725849 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.726306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.803421 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1dd46240-d5db-4cca-a1f3-f8271c4367f8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:48.804641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1dd46240-d5db-4cca-a1f3-f8271c4367f8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:48.810888 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1dd46240-d5db-4cca-a1f3-f8271c4367f8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.811381 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1dd46240-d5db-4cca-a1f3-f8271c4367f8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.812149 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1dd46240-d5db-4cca-a1f3-f8271c4367f8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.812587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1dd46240-d5db-4cca-a1f3-f8271c4367f8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.843834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1dd46240-d5db-4cca-a1f3-f8271c4367f8 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045307 Jun 24 15:24:48.844403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 349/707] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:24:48 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 15:24:48.849179 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:48.849468 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:48.855378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.855826 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.856590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.857028 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.857194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:48.865341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:48.869285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:48.869285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-44f05cde-0813-4618-b1f1-31d887aae73d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.155394 Jun 24 15:24:48.869285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 359/708] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:48 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:48.873191 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:48.873679 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:48.880529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.880982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.881786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:48.882255 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:48.959435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] HTTP exception thrown: Instance 79b13f6b-a027-4371-8012-54f025a726fa is not attached to volume 739ed036-0c4c-43ab-87ec-2525ddec0b7c Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Request method failure captured: Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments/739ed036-0c4c-43ab-87ec-2525ddec0b7c HTTP/1.1 Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdaNZaF-bS2l04pHTmQCA9eSSNLtFUpxg8qnMLP-JXlWVjn2yZPZV8TxkD0PfzRNSABFpwN-stc50faF1YwfOlaohp4pzKdzjpPiELl0gByevuWXon6VsCNzvLOkipnF6sjZgVeHyRA2eXK8LY1kNMyVfqbKqo38R09Ep5i51pQWbe0 Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: fb2390854b0345588bd6b68f5c09a1ee Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-TestMinimumBasicScenario-1016590740 Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:24:48.962482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb2390854b0345588bd6b68f5c09a1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fb2390854b0345588bd6b68f5c09a1ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fb2390854b0345588bd6b68f5c09a1ee", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb2390854b0345588bd6b68f5c09a1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-TestMinimumBasicScenario-1016590740 Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: fb2390854b0345588bd6b68f5c09a1ee Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1016590740 Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-TestMinimumBasicScenario-1016590740-project Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: e4f136ae627b4a81b6b29c667420f1aa Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-TestMinimumBasicScenario-1016590740-project Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:24:48.964196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 79b13f6b-a027-4371-8012-54f025a726fa is not attached to volume 739ed036-0c4c-43ab-87ec-2525ddec0b7c Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'server_id': '79b13f6b-a027-4371-8012-54f025a726fa', 'id': '739ed036-0c4c-43ab-87ec-2525ddec0b7c'} Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 739ed036-0c4c-43ab-87ec-2525ddec0b7c. Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:24:48.965033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b13f6b-a027-4371-8012-54f025a726fa is not attached to volume 739ed036-0c4c-43ab-87ec-2525ddec0b7c Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b13f6b-a027-4371-8012-54f025a726fa is not attached to volume 739ed036-0c4c-43ab-87ec-2525ddec0b7c Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:48.966257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Returning 404 to user: Instance 79b13f6b-a027-4371-8012-54f025a726fa is not attached to volume 739ed036-0c4c-43ab-87ec-2525ddec0b7c {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:24:48.967213 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9a09b21c-77a1-4da3-addc-b6e4417a7ddc tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "DELETE /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments/739ed036-0c4c-43ab-87ec-2525ddec0b7c" status: 404 len: 154 microversion: 2.1 time: 0.094543 Jun 24 15:24:48.967213 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 360/709] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:24:48 2022] DELETE /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa/os-volume_attachments/739ed036-0c4c-43ab-87ec-2525ddec0b7c => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:24:49.005858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:49.014501 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d26a62ed-edc1-44b4-9f0e-c331425a91af tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.169117 Jun 24 15:24:49.015132 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 350/710] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:48 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:49.638164 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-3dcaaed2-2cac-4b0a-bfbd-9391a13b9fb5 req-30e24bcd-f536-41df-a82a-1d3155c8a744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc17ccb-c0b1-4819-9051-e715458f4529", "name": "network-vif-plugged", "status": "completed", "tag": "e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:49.649393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3dcaaed2-2cac-4b0a-bfbd-9391a13b9fb5 req-30e24bcd-f536-41df-a82a-1d3155c8a744 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:49.649393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3dcaaed2-2cac-4b0a-bfbd-9391a13b9fb5 req-30e24bcd-f536-41df-a82a-1d3155c8a744 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:49.662590 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-3dcaaed2-2cac-4b0a-bfbd-9391a13b9fb5 req-30e24bcd-f536-41df-a82a-1d3155c8a744 service nova] Creating event network-vif-plugged:e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc for instance dcc17ccb-c0b1-4819-9051-e715458f4529 on hv-cinder-83538 Jun 24 15:24:49.668847 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-3dcaaed2-2cac-4b0a-bfbd-9391a13b9fb5 req-30e24bcd-f536-41df-a82a-1d3155c8a744 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167056 Jun 24 15:24:49.669459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 361/711] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:24:49.886860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:49.887505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:49.894170 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:49.894615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:49.895412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:49.895884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:49.911860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:50.029980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:50.032959 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:50.033664 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:50.036543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:50.038083 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:50.039799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:50.040974 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-77c9e488-e52c-4a85-acf8-d6311e3d2d6e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.159014 Jun 24 15:24:50.041536 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 351/712] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:49 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:50.046685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:50.046685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:50.046685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:50.046685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:50.179106 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:50.189673 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-12d22ace-190e-41d0-adb9-8f436050dccc tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.161543 Jun 24 15:24:50.193178 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 362/713] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:50 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:50.268311 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:50.268931 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:50.276222 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:50.276714 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:50.277791 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:50.278293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:50.304545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:24:50.520565 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:50.607340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-69d0d510-66c6-4196-9b16-e83d07a80f98 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "DELETE /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 204 len: 0 microversion: 2.1 time: 0.342713 Jun 24 15:24:50.607929 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 352/714] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:24:50 2022] DELETE /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 15:24:50.615999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:50.616612 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:50.623053 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:50.623534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:50.624295 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:50.624731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:50.752859 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:50.760695 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4a0b63d5-4fb1-47c4-8c67-ed96c0a1c5e4 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1553 microversion: 2.1 time: 0.148562 Jun 24 15:24:50.761263 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 363/715] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:50 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:51.060299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:51.060922 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:51.067760 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:51.068210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:51.069012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:51.069456 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:51.200123 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:51.207122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:51.207841 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:51.208347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:51.209845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:51.211913 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8e4da1e9-dc05-470e-9a83-f807e6bc9569 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.155548 Jun 24 15:24:51.212520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 353/716] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:51 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:51.215486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:51.215937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:51.217066 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:51.217166 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:51.362033 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:51.362325 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-996d2601-e6c0-414b-a093-3e9eea5ff269 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.159094 Jun 24 15:24:51.362894 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 364/717] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:51 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:51.779495 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:51.780108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:51.786295 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:51.786745 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:51.787537 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:51.787980 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:51.915775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:51.923196 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d2006a63-bc5d-457a-8012-b76d0bc0f979 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1553 microversion: 2.1 time: 0.148176 Jun 24 15:24:51.923768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 354/718] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:51 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:52.230489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:52.231097 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:52.237698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:52.238155 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:52.238963 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:52.239435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:52.369006 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:52.376911 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:52.378424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:52.379611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-35e73608-23e7-4e78-ae21-1e06c96c1762 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.153422 Jun 24 15:24:52.380177 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 365/719] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:52 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:52.381772 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:52.382375 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:52.389497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:52.389941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:52.390693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:52.391122 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:52.528365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:52.535921 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-85e90fd6-4077-41d3-a288-052dedb24a02 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1266 microversion: 2.1 time: 0.157884 Jun 24 15:24:52.536575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 355/720] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:52 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:52.940955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:52.941568 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:52.948698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:52.949401 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:52.950176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:52.950615 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.235073 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:53.243520 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-71d6657f-e633-4ac6-acb4-478bf73cd348 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1553 microversion: 2.1 time: 0.306606 Jun 24 15:24:53.247298 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 366/721] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:52 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:53.397748 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:53.398424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:53.405585 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:53.406266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.407096 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:53.407621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.474361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-e018228e-1ae5-4109-af2f-3504a334fd34 req-886c57c3-bb88-497e-9caf-9ba40626fa7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b13f6b-a027-4371-8012-54f025a726fa", "name": "network-vif-deleted", "tag": "18c7a045-91ca-44b2-abe0-c90523b83549"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:53.483639 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e018228e-1ae5-4109-af2f-3504a334fd34 req-886c57c3-bb88-497e-9caf-9ba40626fa7a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:53.484258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-e018228e-1ae5-4109-af2f-3504a334fd34 req-886c57c3-bb88-497e-9caf-9ba40626fa7a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.496947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-e018228e-1ae5-4109-af2f-3504a334fd34 req-886c57c3-bb88-497e-9caf-9ba40626fa7a service nova] Creating event network-vif-deleted:18c7a045-91ca-44b2-abe0-c90523b83549 for instance 79b13f6b-a027-4371-8012-54f025a726fa on hv-cinder-83538 Jun 24 15:24:53.502421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-e018228e-1ae5-4109-af2f-3504a334fd34 req-886c57c3-bb88-497e-9caf-9ba40626fa7a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031933 Jun 24 15:24:53.502545 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 367/722] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:53.554180 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:53.555269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:53.558286 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:53.561913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:53.562526 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.563487 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:53.563915 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.567007 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:53.569970 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:53.571763 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a8c709b6-6bd4-4be8-80e3-c3e25f823ca1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.178108 Jun 24 15:24:53.572317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 356/723] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:53 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:53.702382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:53.709851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-64af8fe1-451f-4f88-a989-a014753a78ae tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1452 microversion: 2.1 time: 0.159935 Jun 24 15:24:53.710404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 368/724] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:53 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:24:53.725858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:53.730157 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:53.732300 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:53.732741 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.733491 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:53.733920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:53.882097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:53.891058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d0499ace-3dcf-47fe-bba1-4a252ffafd61 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1452 microversion: 2.1 time: 0.168853 Jun 24 15:24:53.891734 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 357/725] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:53 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:54.260813 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:54.261426 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:54.268458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:54.269139 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:54.270092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:54.270536 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:54.324336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:54.330481 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:54.330481 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lazy-loading 'fault' on Instance uuid 79b13f6b-a027-4371-8012-54f025a726fa {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:24:54.467152 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f136ae627b4a81b6b29c667420f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb2390854b0345588bd6b68f5c09a1ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:54.475357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39c7145e-8650-4940-bf43-694e3f14e081 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 200 len: 1348 microversion: 2.1 time: 0.219316 Jun 24 15:24:54.476066 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 369/726] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:54 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 1348 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:24:54.592182 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:54.592975 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:54.599418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:54.599866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:54.600630 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:54.601055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:55.064461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:55.073067 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:55.074610 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:55.075869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-349dcf6f-910f-4275-bcb0-fe8fd1a0ef7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.490070 Jun 24 15:24:55.076427 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 358/727] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:54 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:55.492414 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:55.493274 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] [instance: 79b13f6b-a027-4371-8012-54f025a726fa] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:55.499348 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:55.499798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:55.500568 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:55.501004 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:55.514471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] HTTP exception thrown: Instance 79b13f6b-a027-4371-8012-54f025a726fa could not be found. Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Request method failure captured: Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa HTTP/1.1 Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdaNZaF-bS2l04pHTmQCA9eSSNLtFUpxg8qnMLP-JXlWVjn2yZPZV8TxkD0PfzRNSABFpwN-stc50faF1YwfOlaohp4pzKdzjpPiELl0gByevuWXon6VsCNzvLOkipnF6sjZgVeHyRA2eXK8LY1kNMyVfqbKqo38R09Ep5i51pQWbe0 Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: fb2390854b0345588bd6b68f5c09a1ee Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-TestMinimumBasicScenario-1016590740 Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:24:55.516118 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb2390854b0345588bd6b68f5c09a1ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fb2390854b0345588bd6b68f5c09a1ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fb2390854b0345588bd6b68f5c09a1ee", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb2390854b0345588bd6b68f5c09a1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-TestMinimumBasicScenario-1016590740 Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: fb2390854b0345588bd6b68f5c09a1ee Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1016590740 Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-TestMinimumBasicScenario-1016590740-project Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: e4f136ae627b4a81b6b29c667420f1aa Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-TestMinimumBasicScenario-1016590740-project Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 79b13f6b-a027-4371-8012-54f025a726fa could not be found. Jun 24 15:24:55.517614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '79b13f6b-a027-4371-8012-54f025a726fa'} Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b13f6b-a027-4371-8012-54f025a726fa could not be found. Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:24:55.518518 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b13f6b-a027-4371-8012-54f025a726fa could not be found. Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b13f6b-a027-4371-8012-54f025a726fa could not be found. Jun 24 15:24:55.519985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:24:55.521598 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Returning 404 to user: Instance 79b13f6b-a027-4371-8012-54f025a726fa could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:24:55.521598 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d6b26a0a-523d-4ade-9101-ccfdbb679458 tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa" status: 404 len: 111 microversion: 2.1 time: 0.029162 Jun 24 15:24:55.521598 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 370/728] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:24:55 2022] GET /compute/v2.1/servers/79b13f6b-a027-4371-8012-54f025a726fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:24:55.527781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8d34ecba-2ce1-45bf-8087-364b42c95c6c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] Calling method '.version_select at 0x7f18b2032ca0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:55.602933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8d34ecba-2ce1-45bf-8087-364b42c95c6c tempest-TestMinimumBasicScenario-1016590740 tempest-TestMinimumBasicScenario-1016590740-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-961804416" status: 202 len: 0 microversion: 2.1 time: 0.080309 Jun 24 15:24:55.603689 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 359/729] 10.222.0.67 () {58 vars in 1268 bytes} [Fri Jun 24 15:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-961804416 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:24:56.096271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:56.097040 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:56.104015 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:56.104467 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:56.105239 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:56.105676 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:56.320832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:56.330607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:56.332620 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:56.334094 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9f67d730-828e-4100-b66a-b66bb321e3ac tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1746 microversion: 2.20 time: 0.241665 Jun 24 15:24:56.334816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 371/730] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:56 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1746 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:56.596563 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-47ab9955-b95b-46dc-98b8-56db42520502 req-cc401d5b-e396-4d50-8512-8b57325fbd7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc17ccb-c0b1-4819-9051-e715458f4529", "tag": "e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:56.605737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-47ab9955-b95b-46dc-98b8-56db42520502 req-cc401d5b-e396-4d50-8512-8b57325fbd7e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:56.606391 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-47ab9955-b95b-46dc-98b8-56db42520502 req-cc401d5b-e396-4d50-8512-8b57325fbd7e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:56.616544 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-47ab9955-b95b-46dc-98b8-56db42520502 req-cc401d5b-e396-4d50-8512-8b57325fbd7e service nova] Creating event network-changed:e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc for instance dcc17ccb-c0b1-4819-9051-e715458f4529 on hv-cinder-83538 Jun 24 15:24:56.622083 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-47ab9955-b95b-46dc-98b8-56db42520502 req-cc401d5b-e396-4d50-8512-8b57325fbd7e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029310 Jun 24 15:24:56.622860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 360/731] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:24:57.357071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:57.358248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:57.365769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:57.366222 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:57.369150 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:57.369150 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:57.671975 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:57.685986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:57.687767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:57.689128 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8b2691d1-5768-468d-9657-96448ddb14a8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1746 microversion: 2.20 time: 0.338135 Jun 24 15:24:57.689937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 372/732] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:57 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1746 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:58.709393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:24:58.710092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:58.717350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:58.717806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:58.718574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:58.719011 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:59.124553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:59.132925 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:59.134446 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:24:59.135615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e7b84ebb-0071-4ae1-b5e9-7ba331451d84 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1746 microversion: 2.20 time: 0.431015 Jun 24 15:24:59.136173 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 361/733] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:24:58 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1746 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:24:59.830385 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:24:59.830914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:24:59.840091 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:59.840629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:59.841652 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:24:59.842099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:24:59.869593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lazy-loading 'flavor' on Instance uuid 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:25:00.134786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c390f4d6-867b-42ce-b9ee-eb873d18821e tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "POST /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080/action" status: 202 len: 0 microversion: 2.1 time: 0.309004 Jun 24 15:25:00.135531 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 373/734] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:24:59 2022] POST /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:25:00.143934 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:00.144565 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:00.152280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:00.152732 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:00.153749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:00.153955 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:00.155937 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:00.156655 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:00.163384 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:00.163802 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:00.165063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:00.165560 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:00.170882 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:00.484405 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:00.499700 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:00.501917 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:00.502340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:00.508687 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5a3bed2f-6134-4c82-8755-5f64897328ab tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.353390 Jun 24 15:25:00.513728 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b3df3a3c-7efd-4c29-9b87-8124cdf8e561 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.373562 Jun 24 15:25:00.514307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 362/736] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:00 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:00.514573 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 374/736] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:00 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:01.526362 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:01.528986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:01.531593 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:01.532935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:01.538697 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:01.542366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:01.542491 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:01.542584 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:01.542686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:01.542772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:01.542851 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:01.542851 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:01.840472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:01.872875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:01.877536 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:01.886984 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a14b3730-e078-4147-b29c-5b0a4954a9ed tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.359179 Jun 24 15:25:01.887429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:01.891594 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8dcb4836-f645-408f-ab1f-5d3c14b856a7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.368685 Jun 24 15:25:01.891870 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 363/737] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:01 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:25:01.892386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 375/738] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:01 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:02.068339 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-fac8bece-af89-427c-a684-921e4440d233 req-c27deafc-9974-405b-b0e0-293bf77e49b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffef349a-ea09-44f9-9cd1-cf5d9b905e50", "name": "network-vif-plugged", "status": "completed", "tag": "98f0ee1c-7936-46ad-937e-8e43f17d155f"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:02.082106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-fac8bece-af89-427c-a684-921e4440d233 req-c27deafc-9974-405b-b0e0-293bf77e49b1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:02.082570 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-fac8bece-af89-427c-a684-921e4440d233 req-c27deafc-9974-405b-b0e0-293bf77e49b1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:02.109799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-fac8bece-af89-427c-a684-921e4440d233 req-c27deafc-9974-405b-b0e0-293bf77e49b1 service nova] Creating event network-vif-plugged:98f0ee1c-7936-46ad-937e-8e43f17d155f for instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 on hv-cinder-83538 Jun 24 15:25:02.115168 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-fac8bece-af89-427c-a684-921e4440d233 req-c27deafc-9974-405b-b0e0-293bf77e49b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050586 Jun 24 15:25:02.115796 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 364/739] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:25:02.909404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:02.910020 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:02.917956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:02.918568 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:02.920858 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:02.921603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:02.922632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:02.923401 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:02.931401 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:02.931864 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:02.932651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:02.937091 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:03.260876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:03.272135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5dc59745-64fa-4489-b629-9aea4841db31 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.366695 Jun 24 15:25:03.272955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 376/740] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:02 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:03.329268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:03.339004 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:03.341001 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:03.342237 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-21b40305-90e1-4a57-8bc7-5034a2a31148 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.430659 Jun 24 15:25:03.347791 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 365/741] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:02 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:04.297223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:04.300775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:04.331076 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:04.331863 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:04.334283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:04.335554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:04.371515 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:04.372522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:04.386486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:04.387979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:04.389833 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:04.390870 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:04.631664 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:04.656185 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e316bebf-7850-42ed-837a-099ddc3493c1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.368849 Jun 24 15:25:04.662284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 377/742] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:04 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:04.662575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:04.686100 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:04.689467 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:04.690966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cd820c3f-ee6a-4c7c-94b8-e0802e0a80f4 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.328134 Jun 24 15:25:04.698723 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 366/743] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:04 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:05.677883 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:05.678452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:05.691135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:05.700392 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:05.701245 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:05.701671 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:05.711272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:05.711886 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:05.724680 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:05.725132 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:05.726679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:05.727289 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:06.120028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:06.140884 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-532a76f4-670a-481d-a0c6-9e6f64ca77c9 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.456614 Jun 24 15:25:06.140884 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 378/744] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:05 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:06.152300 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:06.175042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:06.176820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:06.178491 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2c9ae9ff-ece6-4e73-957c-c4d04f4a6dc6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.471098 Jun 24 15:25:06.187317 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 367/745] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:05 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:07.156488 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:07.158162 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:07.179364 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:07.179364 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:07.179364 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:07.179364 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:07.197978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:07.199133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:07.213990 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:07.214737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:07.215554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:07.216187 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:07.450222 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:07.458332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0424fe6c-2e57-4c7f-951a-ccadb1ac6a53 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.305993 Jun 24 15:25:07.467529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 379/746] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:07 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:07.518474 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:07.521106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:07.527939 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:07.529652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:07.531049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d5257207-7d51-41e4-918d-caff0482de8b tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.336937 Jun 24 15:25:07.532050 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 368/747] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:07 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:08.482959 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:08.484398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:08.499070 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:08.499593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:08.500431 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:08.500872 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:08.552078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:08.553369 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:08.563775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:08.574907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:08.577231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:08.578463 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:08.785816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:08.794343 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-babf3101-e0d4-454f-9ecb-1b3fc6974702 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.315221 Jun 24 15:25:08.795537 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 380/748] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:08 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:08.827080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:08.837831 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:08.841368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:08.843537 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8bf4871e-8cc0-407e-a29c-a746d56bb486 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.296007 Jun 24 15:25:08.849172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 369/749] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:08 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:25:09.812554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:09.819737 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:09.828247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:09.828982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:09.829947 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:09.830565 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:09.865505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:09.867599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:09.874324 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:09.874782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:09.875688 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:09.876543 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:10.435367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:10.451419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:10.453273 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:10.454457 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3facd07a-e028-4d3e-8d94-4ae9336c6fc5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.596017 Jun 24 15:25:10.460284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:10.471383 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 370/750] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:09 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:10.472130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0276777d-8e09-4e69-b31c-7392ed5bca88 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.664033 Jun 24 15:25:10.472733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 381/751] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:09 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:11.474228 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:11.475023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:11.483285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:11.483845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:11.484807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:11.485367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:11.490578 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:11.491223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:11.498133 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:11.498603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:11.499468 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:11.499952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:11.713845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:11.718041 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:11.723496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:11.725347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:11.725994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3fefae28-7975-43cc-aa94-9de691a3b169 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.239702 Jun 24 15:25:11.727354 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-dd10b1e6-dd6d-4545-ae08-9d0bde16ea93 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.257657 Jun 24 15:25:11.727501 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 382/752] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:11 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:11.733551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 371/753] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:11 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:12.745160 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:12.745970 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:12.746131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:12.746744 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:12.753069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:12.753514 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:12.754330 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:12.754764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:12.761356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:12.761801 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:12.762694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:12.763141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:12.959130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:12.964926 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:12.967386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-94b30cad-8176-4dc5-9643-8354516f69cc tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.226977 Jun 24 15:25:12.968024 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 383/754] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:12 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:12.984694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:12.984694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:12.984694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8c3ae154-2ac4-4283-af28-552819509879 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1741 microversion: 2.20 time: 0.234936 Jun 24 15:25:12.985111 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 372/755] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:12 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:25:13.986193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:13.987245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:13.994168 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:13.994623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:13.995500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:13.995945 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:14.001762 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:14.002381 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:14.009787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:14.010236 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:14.011005 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:14.011576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:14.201582 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:14.212891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-356b68f3-2e68-468b-a18d-e479088437d3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1567 microversion: 2.1 time: 0.231194 Jun 24 15:25:14.213506 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:14.214450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 373/756] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:13 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:14.223613 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:14.226712 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:14.234880 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e1478c60-b2ba-447c-a1b3-06158e833576 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1723 microversion: 2.20 time: 0.237037 Jun 24 15:25:14.236731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 384/757] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:13 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:25:14.247945 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5a872e99-aec9-4d51-8d40-1bb3a57a54f4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:14.249986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5a872e99-aec9-4d51-8d40-1bb3a57a54f4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:14.262097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a872e99-aec9-4d51-8d40-1bb3a57a54f4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:14.262548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a872e99-aec9-4d51-8d40-1bb3a57a54f4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:14.263407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a872e99-aec9-4d51-8d40-1bb3a57a54f4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:14.263944 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5a872e99-aec9-4d51-8d40-1bb3a57a54f4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:14.654879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5a872e99-aec9-4d51-8d40-1bb3a57a54f4 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "POST /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080/action" status: 202 len: 0 microversion: 2.1 time: 0.421703 Jun 24 15:25:14.655483 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 374/758] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:25:14 2022] POST /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:25:14.663787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:14.665359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:14.671624 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:14.672069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:14.672960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:14.673449 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:14.812401 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:14.820857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2f974a23-9953-4420-8715-42ebdd7c6c2b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1515 microversion: 2.1 time: 0.161150 Jun 24 15:25:14.822075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 385/759] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:14 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:15.265156 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:15.265789 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:15.272034 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:15.272989 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:15.274003 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:15.274586 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:15.416192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:15.424265 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:15.425784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:15.426966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9a78d2d-7a5d-4cdf-be0e-aaf2aa7127d1 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1723 microversion: 2.20 time: 0.166459 Jun 24 15:25:15.427581 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 375/760] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:15 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:15.837832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:15.838410 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:15.844952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:15.845398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:15.846157 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:15.846585 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:15.983554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:15.998830 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f4ab1b9a-4fec-4089-939c-b148ac422f86 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1515 microversion: 2.1 time: 0.164760 Jun 24 15:25:15.999628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 386/761] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:15 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:16.020713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-76a3e347-400b-4f2e-9b5c-58221c6ac74e req-767daaba-e5b7-4a6a-9252-445bfc5ecc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffef349a-ea09-44f9-9cd1-cf5d9b905e50", "name": "network-vif-unplugged", "status": "completed", "tag": "98f0ee1c-7936-46ad-937e-8e43f17d155f"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:16.029422 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-76a3e347-400b-4f2e-9b5c-58221c6ac74e req-767daaba-e5b7-4a6a-9252-445bfc5ecc79 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:16.029872 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-76a3e347-400b-4f2e-9b5c-58221c6ac74e req-767daaba-e5b7-4a6a-9252-445bfc5ecc79 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:16.041486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-76a3e347-400b-4f2e-9b5c-58221c6ac74e req-767daaba-e5b7-4a6a-9252-445bfc5ecc79 service nova] Creating event network-vif-unplugged:98f0ee1c-7936-46ad-937e-8e43f17d155f for instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 on hv-cinder-83538 Jun 24 15:25:16.046467 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-76a3e347-400b-4f2e-9b5c-58221c6ac74e req-767daaba-e5b7-4a6a-9252-445bfc5ecc79 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029481 Jun 24 15:25:16.048986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 376/762] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:25:16.448230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:16.449013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:16.455381 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:16.455841 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:16.456614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:16.457051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:16.606284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:16.614297 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:16.615924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:16.617775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a12f42cd-6a7e-4d33-8fb8-a64e4065223d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1723 microversion: 2.20 time: 0.175821 Jun 24 15:25:16.618336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 387/763] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:16 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:17.017304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:17.018147 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:17.025486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:17.026033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:17.026751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:17.027266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:17.164627 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:17.172735 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e4e1bd93-d129-41a3-afcd-7a2dc8c8e0ad tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1517 microversion: 2.1 time: 0.160117 Jun 24 15:25:17.173307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 377/764] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:17 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:17.636577 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:17.637184 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:17.643703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:17.646450 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:17.646450 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:17.646450 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:17.833459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:17.842136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:17.843580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:17.855331 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-04d1e215-57ee-4d63-9917-f8744ba0b4ce tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1666 microversion: 2.20 time: 0.212944 Jun 24 15:25:17.855331 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 388/765] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:17 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1666 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:17.862738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-29ff94a1-1dec-4852-ad15-08206c95d084 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de9e514-bf44-4b1b-8d1b-8a26de901b59"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:17.863904 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-29ff94a1-1dec-4852-ad15-08206c95d084 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:17.870740 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29ff94a1-1dec-4852-ad15-08206c95d084 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:17.871236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29ff94a1-1dec-4852-ad15-08206c95d084 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:17.871988 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29ff94a1-1dec-4852-ad15-08206c95d084 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:17.872418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-29ff94a1-1dec-4852-ad15-08206c95d084 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:18.061597 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-0c6dd021-004a-40be-8772-f702af21bd51 req-a7a62f31-8a5e-4e13-a526-02bca24a7bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa864c2-63a6-4aa7-8ea6-3ce12daff080", "name": "network-vif-unplugged", "status": "completed", "tag": "e9c0e7f6-a572-47c4-8390-be9bdb776041"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:18.070109 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-0c6dd021-004a-40be-8772-f702af21bd51 req-a7a62f31-8a5e-4e13-a526-02bca24a7bad service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:18.070755 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-0c6dd021-004a-40be-8772-f702af21bd51 req-a7a62f31-8a5e-4e13-a526-02bca24a7bad service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:18.086361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-0c6dd021-004a-40be-8772-f702af21bd51 req-a7a62f31-8a5e-4e13-a526-02bca24a7bad service nova] Creating event network-vif-unplugged:e9c0e7f6-a572-47c4-8390-be9bdb776041 for instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 on hv-cinder-83538 Jun 24 15:25:18.093988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-0c6dd021-004a-40be-8772-f702af21bd51 req-a7a62f31-8a5e-4e13-a526-02bca24a7bad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036016 Jun 24 15:25:18.094719 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 389/766] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:25:18.191396 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:18.192090 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:18.198288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:18.198730 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:18.199512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:18.199950 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:18.339379 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:18.347075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-36740025-c9a4-4481-b985-26662a5e11c8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.159735 Jun 24 15:25:18.347848 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 390/767] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:18 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:25:18.826371 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-29ff94a1-1dec-4852-ad15-08206c95d084 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.967512 Jun 24 15:25:18.827002 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 378/768] 10.222.0.67 () {62 vars in 1363 bytes} [Fri Jun 24 15:25:17 2022] POST /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-volume_attachments => generated 188 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 15:25:18.951603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7de924ea-45c6-4b70-8b05-fa298a1ae1d0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:18.952126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7de924ea-45c6-4b70-8b05-fa298a1ae1d0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:18.958778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7de924ea-45c6-4b70-8b05-fa298a1ae1d0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:18.959251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7de924ea-45c6-4b70-8b05-fa298a1ae1d0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:18.960013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7de924ea-45c6-4b70-8b05-fa298a1ae1d0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:18.961100 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7de924ea-45c6-4b70-8b05-fa298a1ae1d0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:18.975942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:19.364091 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:19.364715 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:19.374923 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:19.378897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:19.378897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:19.378897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:19.489751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7de924ea-45c6-4b70-8b05-fa298a1ae1d0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-volume_attachments/5de9e514-bf44-4b1b-8d1b-8a26de901b59" status: 202 len: 0 microversion: 2.20 time: 0.541875 Jun 24 15:25:19.490769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 391/769] 10.222.0.67 () {60 vars in 1456 bytes} [Fri Jun 24 15:25:18 2022] DELETE /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-volume_attachments/5de9e514-bf44-4b1b-8d1b-8a26de901b59 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:25:19.525446 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:19.533080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1652b913-48e7-4ab5-93b9-9c87fdfc155f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.172887 Jun 24 15:25:19.533737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 379/770] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:19 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:19.555345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6a2cf629-5804-4ad9-adc3-566eccacfddb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:19.555905 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6a2cf629-5804-4ad9-adc3-566eccacfddb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:19.562375 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a2cf629-5804-4ad9-adc3-566eccacfddb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:19.562821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a2cf629-5804-4ad9-adc3-566eccacfddb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:19.563617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a2cf629-5804-4ad9-adc3-566eccacfddb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:19.564048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6a2cf629-5804-4ad9-adc3-566eccacfddb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:19.775461 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6a2cf629-5804-4ad9-adc3-566eccacfddb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "POST /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/action" status: 202 len: 0 microversion: 2.20 time: 0.224175 Jun 24 15:25:19.775998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 392/771] 10.222.0.67 () {62 vars in 1318 bytes} [Fri Jun 24 15:25:19 2022] POST /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:25:19.784301 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:19.784935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:19.791130 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:19.791604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:19.792482 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:19.792941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:19.928661 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:19.938030 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:19.939580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:19.940788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ba428291-95a8-4811-93e9-bc75d3f385cb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1674 microversion: 2.20 time: 0.160503 Jun 24 15:25:19.941553 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 380/772] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:19 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:25:20.553773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:20.556754 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:20.561706 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:20.562163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:20.563600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:20.564221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:20.709426 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:20.717880 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-96ac4cbb-7dc0-49e6-ac75-0dad4b048c44 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.170098 Jun 24 15:25:20.718441 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 393/773] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:20 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:20.960271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:20.961103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:20.967444 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:20.971898 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:20.971898 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:20.971898 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:21.103514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:21.111525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:21.113027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:21.114364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8e68e603-9e78-42d8-88f2-0d55893bdaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1674 microversion: 2.20 time: 0.158043 Jun 24 15:25:21.114920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 381/774] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:20 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:21.735236 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:21.735954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:21.738182 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=68 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:21.743064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:21.743552 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:21.744330 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:21.744772 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:21.884541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:21.892490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-39e1457c-3e73-4e73-a37d-8997ce8fccf1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.161116 Jun 24 15:25:21.893188 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 394/775] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:21 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:22.133619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:22.134225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:22.136696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:22.141419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:22.141881 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:22.142644 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:22.143080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:22.158805 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:22.275500 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:22.283342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:22.284917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:22.286151 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-601d49a3-90d3-46d0-9508-d7b8134e193d tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.156378 Jun 24 15:25:22.286788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 382/776] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:22 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:22.910444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:22.911056 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:22.919000 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:22.919483 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:22.920335 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:22.920758 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:23.152829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:23.168545 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c22e61ed-b92b-442b-9fdd-3e39c9012ee0 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.261912 Jun 24 15:25:23.169389 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 395/777] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:22 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:23.306061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:23.306758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:23.314775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:23.315263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:23.316034 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:23.316464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:23.478709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:23.489290 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:23.491625 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:23.492878 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e617f78b-6599-4ce0-8f7c-3d3318846d58 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.191994 Jun 24 15:25:23.493452 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 383/778] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:23 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:24.186468 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:24.187061 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:24.195170 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:24.196024 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:24.196911 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:24.197527 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:24.350492 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:24.358549 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-78f3d8b4-05ee-4561-a1ad-9a52a5b8644f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.176175 Jun 24 15:25:24.359134 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 396/779] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:24 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:24.512208 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:24.513545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:24.520912 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:24.521629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:24.522439 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:24.523134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:24.671339 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:24.679853 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:24.681415 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:24.682579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-406a519f-d71e-4692-abfc-7bdf3971e6bb tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.175422 Jun 24 15:25:24.683172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 384/780] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:24 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:25.376829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:25.377443 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:25.383670 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:25.384166 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:25.384914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:25.385349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:25.534349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:25.542757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e3b0dfa7-9648-4c76-9542-6a9d19a4ad54 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.170617 Jun 24 15:25:25.543374 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 397/781] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:25 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:25.702739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:25.703389 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:25.710655 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:25.711089 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:25.711884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:25.712321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:25.857844 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:25.866201 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:25.872166 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:25.873505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2e150d2e-ecb9-4b3b-9359-373453ee1853 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.174732 Jun 24 15:25:25.874191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 385/782] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:25 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:26.562605 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:26.563368 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:26.570274 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:26.570781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:26.571604 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:26.572051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:26.731548 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:26.739542 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-702043d6-204e-40f2-b7e4-b7369b7f128d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.182188 Jun 24 15:25:26.740137 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 398/783] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:26 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:26.892836 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:26.893638 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:26.901008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:26.901848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:26.902854 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:26.903419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:27.046437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:27.057278 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:27.059163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:27.060494 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5cc4f8cd-8da8-4bfd-9d9a-089ee7b87950 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.171892 Jun 24 15:25:27.061516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 386/784] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:26 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:25:27.757150 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:27.758110 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:27.765460 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:27.766034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:27.766898 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:27.767481 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:27.922554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:27.932804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-194f6252-eab9-42b9-838e-2e779bc6c6d7 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.180522 Jun 24 15:25:27.940738 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 399/785] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:27 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:25:28.078464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:28.079065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:28.086253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:28.088578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:28.088578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:28.088578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:28.227927 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:28.244804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:28.247370 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:28.249263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1f3af880-66dd-464a-a475-4767e8952d7f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.174718 Jun 24 15:25:28.249919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 387/786] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:28 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:28.955014 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:28.955733 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:28.963322 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:28.963781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:28.964564 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:28.965036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:29.146926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:29.155503 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e2276afe-b9b5-4d15-b9e3-5dfdef53242b tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.208627 Jun 24 15:25:29.156074 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 400/787] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:28 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:29.267447 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:29.268148 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:29.276610 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:29.277086 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:29.277936 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:29.278440 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:29.446336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:29.456319 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:29.458136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:29.459696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b3bf38fc-18b8-4a95-b3b9-dcc3c0298780 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.196093 Jun 24 15:25:29.460602 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 388/788] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:29 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:30.174326 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:30.174980 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:30.182215 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:30.182669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:30.185110 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:30.185588 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:30.360151 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:30.371232 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-89fa66f0-783b-4b34-8fef-8c1c37c796f1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.201032 Jun 24 15:25:30.372100 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 401/789] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:30 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:30.478857 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:30.480247 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:30.487507 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:30.487965 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:30.490362 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:30.490815 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:30.677784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:30.686400 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:30.688199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:30.689614 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4ac97823-cd89-4ca1-a436-6a6cc707bfed tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.215193 Jun 24 15:25:30.690154 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 389/790] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:30 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:31.389692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:31.393581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:31.396464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:31.396930 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:31.398214 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:31.398650 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:31.534667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:31.542387 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-76ac2197-c127-4e9b-b95b-88b97337811d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.156628 Jun 24 15:25:31.542944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 402/791] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:31 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:31.707551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:31.708424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:31.716247 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:31.721932 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:31.721932 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:31.721932 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:31.848131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:31.856049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:31.857533 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:31.858676 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bff6562c-56c2-40a3-b5c4-81d61a93387f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.155038 Jun 24 15:25:31.859260 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 390/792] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:31 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:32.559885 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:32.560423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:32.566819 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:32.567294 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:32.568050 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:32.568474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:32.702653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:32.710787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0e013c1b-7da0-4ee3-b67f-2de14f19e0a3 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.154264 Jun 24 15:25:32.711453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 403/793] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:32 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:32.877508 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:32.878055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:32.884560 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:32.885007 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:32.885811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:32.886248 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:33.018326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:33.027163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:33.028674 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:33.029810 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6eb86640-5e04-40f9-87e9-1a9d5b33afd7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.156378 Jun 24 15:25:33.030485 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 391/794] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:32 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:33.728472 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:33.729085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:33.735652 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:33.736103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:33.736874 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:33.737313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:33.754955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:33.870835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:33.878398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ff37e00a-ad88-4ce2-bf44-b93302a5a5e8 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.154364 Jun 24 15:25:33.878966 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 404/795] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:33 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:34.048504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:34.049036 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:34.055552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:34.056000 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:34.056758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:34.057192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:34.183709 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:34.191801 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:34.193293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:34.194460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-cd3e7946-1676-4597-b4db-9c1528df7d74 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.149869 Jun 24 15:25:34.195697 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 392/796] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:34 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:25:34.896405 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:34.897050 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:34.904809 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:34.905263 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:34.906032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:34.906474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:35.034337 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:35.042715 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ea8b9144-d8e0-4ff8-9bb3-41306ac46d1f tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.150556 Jun 24 15:25:35.043309 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 405/797] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:34 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:35.213579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:35.214103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:35.220555 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:35.221004 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:35.221762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:35.222199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:35.355108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:35.363021 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:35.364548 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:35.365710 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2d949593-b5e8-464b-84f9-c51d721dbb7e tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.156824 Jun 24 15:25:35.366276 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 393/798] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:35 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:36.060541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:36.061440 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:36.069892 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:36.070439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:36.071887 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:36.072479 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:36.222832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:36.231757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-79dd52b4-69bc-4bbe-bdb1-11d72c968e3a tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.175688 Jun 24 15:25:36.232340 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 406/799] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:36 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:36.424312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:36.424312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:36.424312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:36.424312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:36.426328 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:36.426328 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:36.552208 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:36.564092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:36.566115 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:36.567318 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-64568601-4cfa-45c0-b363-67abab95df46 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.187126 Jun 24 15:25:36.568099 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 394/800] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:36 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:37.249680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:37.250294 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:37.256777 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:37.257231 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:37.258001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:37.258512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:37.390873 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:37.398824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-3ca78f88-c8ac-49c8-8d01-abfc1d0fd031 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.153152 Jun 24 15:25:37.400156 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 407/801] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:37 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:37.586972 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:37.591577 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:37.595831 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:37.596404 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:37.597294 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:37.597844 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:37.733805 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:37.741856 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:37.743393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:37.744628 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-40945b3c-3968-4e11-9a40-b9da31352e57 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.162619 Jun 24 15:25:37.745173 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 395/802] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:37 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:38.416477 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:38.417091 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:38.423634 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:38.424085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:38.424882 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:38.425321 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:38.560774 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:38.570395 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-239fc1a8-a6ab-44d2-8e6d-d2aa714d18dd tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.158308 Jun 24 15:25:38.572450 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 408/803] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:38 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:38.652527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-db6bcfb7-da2f-431f-b2e2-9a7c7147baed req-c2009527-2908-4de2-a1a0-419e72e286b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffef349a-ea09-44f9-9cd1-cf5d9b905e50", "name": "network-vif-plugged", "status": "completed", "tag": "98f0ee1c-7936-46ad-937e-8e43f17d155f"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:38.660964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-db6bcfb7-da2f-431f-b2e2-9a7c7147baed req-c2009527-2908-4de2-a1a0-419e72e286b5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:38.661408 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-db6bcfb7-da2f-431f-b2e2-9a7c7147baed req-c2009527-2908-4de2-a1a0-419e72e286b5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:38.673043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-db6bcfb7-da2f-431f-b2e2-9a7c7147baed req-c2009527-2908-4de2-a1a0-419e72e286b5 service nova] Creating event network-vif-plugged:98f0ee1c-7936-46ad-937e-8e43f17d155f for instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 on hv-cinder-83538 Jun 24 15:25:38.678046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-db6bcfb7-da2f-431f-b2e2-9a7c7147baed req-c2009527-2908-4de2-a1a0-419e72e286b5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029951 Jun 24 15:25:38.678808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 396/804] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:25:38.764131 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:38.764740 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:38.770798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:38.771277 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:38.772055 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:38.772490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:38.910771 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:38.921371 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:38.922955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:38.924228 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b287221d-82b3-4397-b8db-3c919cb651c0 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.164894 Jun 24 15:25:38.924857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 409/805] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:38 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:25:39.588769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:39.589426 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:39.595680 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:39.596129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:39.596891 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:39.597332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:39.731673 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:39.739143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a5d60166-a809-4f0b-b52a-1c3ed6e99574 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.155046 Jun 24 15:25:39.739731 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 397/806] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:39 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:39.942988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:39.943703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:39.950581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:39.951043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:39.951851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:39.952291 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:40.083535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:40.093511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:40.095346 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:40.096507 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ed774f9-186e-46e8-bf7a-725ce455277f tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.157511 Jun 24 15:25:40.097068 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 410/807] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:39 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:40.693826 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-64e77831-7ac7-4db4-8d1c-15665ce9c0ee req-48dcbf56-b99d-4c7f-98b9-124b43f3c4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa864c2-63a6-4aa7-8ea6-3ce12daff080", "name": "network-vif-plugged", "status": "completed", "tag": "e9c0e7f6-a572-47c4-8390-be9bdb776041"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:25:40.704999 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-64e77831-7ac7-4db4-8d1c-15665ce9c0ee req-48dcbf56-b99d-4c7f-98b9-124b43f3c4a8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:40.705457 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-64e77831-7ac7-4db4-8d1c-15665ce9c0ee req-48dcbf56-b99d-4c7f-98b9-124b43f3c4a8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:40.719621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-64e77831-7ac7-4db4-8d1c-15665ce9c0ee req-48dcbf56-b99d-4c7f-98b9-124b43f3c4a8 service nova] Creating event network-vif-plugged:e9c0e7f6-a572-47c4-8390-be9bdb776041 for instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 on hv-cinder-83538 Jun 24 15:25:40.725281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-64e77831-7ac7-4db4-8d1c-15665ce9c0ee req-48dcbf56-b99d-4c7f-98b9-124b43f3c4a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035346 Jun 24 15:25:40.726138 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 398/808] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:25:40.757184 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:40.757799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:40.765489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:40.765936 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:40.766766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:40.767215 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:40.908526 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:40.916282 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-33052734-718a-4284-a858-d6a124ef7727 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.163154 Jun 24 15:25:40.916850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 411/809] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:40 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:25:41.116517 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:41.117296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:41.124782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:41.125240 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:41.126325 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:41.126652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:41.268347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:41.277755 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:41.281121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:41.281121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c6eba41b-b7f2-49c5-8952-e8b92f6af876 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1732 microversion: 2.20 time: 0.169156 Jun 24 15:25:41.281121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 399/810] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:41 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:41.933850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:41.934455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:41.941089 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:41.941539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:41.942313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:41.942794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:42.080847 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:42.089284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6446be34-349c-44c7-b8a2-abe0d84da61d tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1573 microversion: 2.1 time: 0.160595 Jun 24 15:25:42.098857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 412/811] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:41 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:25:42.299143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:42.299816 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:42.307382 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:42.307836 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:42.308641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:42.309619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:42.324686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=100 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:42.438623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:42.448775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:42.453615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:42.453615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-04ce5695-12ad-44fe-8bbd-9a55a81cd9bf tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1719 microversion: 2.20 time: 0.156186 Jun 24 15:25:42.453615 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 400/812] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:25:42 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:25:43.106493 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:25:43.107112 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:25:43.113672 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:43.114120 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:43.114886 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:25:43.115351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:25:43.248752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:25:43.256269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-32871a7f-cef7-4764-9ca7-328d72b68cb1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1560 microversion: 2.1 time: 0.154285 Jun 24 15:25:43.256836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 413/813] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:25:43 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:15.450584 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ef800102-cdec-4865-b789-03b8c806f899 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:15.451541 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ef800102-cdec-4865-b789-03b8c806f899 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:15.453768 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=37 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:15.454442 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:15.459254 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef800102-cdec-4865-b789-03b8c806f899 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:15.459713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef800102-cdec-4865-b789-03b8c806f899 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:15.460481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef800102-cdec-4865-b789-03b8c806f899 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:15.460926 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ef800102-cdec-4865-b789-03b8c806f899 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:15.488507 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ef800102-cdec-4865-b789-03b8c806f899 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042493 Jun 24 15:26:15.489056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 401/814] 10.222.0.67 () {60 vars in 1342 bytes} [Fri Jun 24 15:26:15 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:15.547429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:15.547968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:15.551270 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=39 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:15.551925 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=56 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:15.555454 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:15.556735 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:15.557689 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:15.558084 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:15.584039 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:26:15.836840 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f90d46f0-6958-4d3e-8607-8c896bd6ba3c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 204 len: 0 microversion: 2.20 time: 0.292863 Jun 24 15:26:15.837579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 414/815] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Jun 24 15:26:15 2022] DELETE /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 15:26:15.846299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:15.847906 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:15.854064 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:15.854510 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:15.855395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:15.855826 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:15.985006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:15.993721 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:15.995227 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:15.996365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f7c8c99e-1b03-4806-9ad1-f8165cb751a5 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.154561 Jun 24 15:26:15.997023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 402/816] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:26:15 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:26:17.015779 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:17.016502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:17.023110 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:17.023592 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:17.024752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:17.025194 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:17.156752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:17.164747 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:17.166832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:17.168071 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7f3e2f07-5d1a-43da-84a5-a917e71dbed8 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1725 microversion: 2.20 time: 0.156630 Jun 24 15:26:17.168613 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 415/817] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:26:17 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 15:26:18.146842 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-6add25a3-05b1-45f8-b0e8-57d39155447a req-a748a5c9-22ad-488e-987a-3a3818bb62d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffef349a-ea09-44f9-9cd1-cf5d9b905e50", "name": "network-vif-deleted", "tag": "98f0ee1c-7936-46ad-937e-8e43f17d155f"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:26:18.160863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-6add25a3-05b1-45f8-b0e8-57d39155447a req-a748a5c9-22ad-488e-987a-3a3818bb62d3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:18.160863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-6add25a3-05b1-45f8-b0e8-57d39155447a req-a748a5c9-22ad-488e-987a-3a3818bb62d3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:18.168320 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-6add25a3-05b1-45f8-b0e8-57d39155447a req-a748a5c9-22ad-488e-987a-3a3818bb62d3 service nova] Creating event network-vif-deleted:98f0ee1c-7936-46ad-937e-8e43f17d155f for instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 on hv-cinder-83538 Jun 24 15:26:18.173578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-6add25a3-05b1-45f8-b0e8-57d39155447a req-a748a5c9-22ad-488e-987a-3a3818bb62d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030195 Jun 24 15:26:18.174096 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 403/818] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:26:18.187232 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:18.188520 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:18.195329 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:18.195792 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:18.196763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:18.197695 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:18.263617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:18.280015 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:18.281576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '206ca9f278fc47e4a9a4f720083e91f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4807ce933f14af0be22dd1cf3635c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:18.282728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7760fcc6-fc63-40d3-9b69-170ca60b35dc tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 200 len: 1657 microversion: 2.20 time: 0.099681 Jun 24 15:26:18.283500 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 416/819] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:26:18 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 1657 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 15:26:19.303105 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:19.303897 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:19.310135 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:19.310586 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:19.311387 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:19.311838 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:19.324772 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] HTTP exception thrown: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Request method failure captured: Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 HTTP/1.1 Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXTIiYuacPdHWX3E1lUHFgtQMijXcnvYw2JPcLtOPfV0_8pb7xj0ucDbp_9bewf8RR6-2tLzGiEY2eT4t3YmlZaOLBdmNGbwzGTQegnkpIG3pZ1vlOHdUn6nHD8yhIwJxev9CCD8M6pemSPIummUMUgE23ZTfi090IlCTFtJxzWLb0 Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:26:19.326395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c4807ce933f14af0be22dd1cf3635c2f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 206ca9f278fc47e4a9a4f720083e91f3 Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:19.328215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'ffef349a-ea09-44f9-9cd1-cf5d9b905e50'} Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:26:19.329054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:19.330604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:19.332265 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Returning 404 to user: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:26:19.332265 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e1afd2b0-ee19-4598-bd39-e7b5b1beaf4c tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 404 len: 111 microversion: 2.20 time: 0.029397 Jun 24 15:26:19.332265 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 404/820] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:26:19 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:26:19.336505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8e7724ff-6bbc-4428-a701-15b6dc192354 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '.version_select at 0x7f18b294f430>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:19.426562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8e7724ff-6bbc-4428-a701-15b6dc192354 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123490869" status: 204 len: 0 microversion: 2.20 time: 0.093771 Jun 24 15:26:19.427146 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 417/821] 10.222.0.67 () {60 vars in 1261 bytes} [Fri Jun 24 15:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123490869 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 15:26:21.520559 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:21.521068 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:21.528414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:21.528941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:21.529777 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:21.530215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:21.544130 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] HTTP exception thrown: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Request method failure captured: Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 HTTP/1.1 Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXTIiYuacPdHWX3E1lUHFgtQMijXcnvYw2JPcLtOPfV0_8pb7xj0ucDbp_9bewf8RR6-2tLzGiEY2eT4t3YmlZaOLBdmNGbwzGTQegnkpIG3pZ1vlOHdUn6nHD8yhIwJxev9CCD8M6pemSPIummUMUgE23ZTfi090IlCTFtJxzWLb0 Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:26:21.545667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c4807ce933f14af0be22dd1cf3635c2f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 206ca9f278fc47e4a9a4f720083e91f3 Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.547296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'ffef349a-ea09-44f9-9cd1-cf5d9b905e50'} Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:26:21.548041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.549234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.550423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Returning 404 to user: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:26:21.550423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d704ba8b-47fc-46cb-ac7e-9eb64c4c6613 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 404 len: 111 microversion: 2.20 time: 0.030282 Jun 24 15:26:21.550423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 405/822] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Jun 24 15:26:21 2022] DELETE /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:26:21.555422 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:21.556029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: ffef349a-ea09-44f9-9cd1-cf5d9b905e50] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:21.563444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:21.563898 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:21.564668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:21.565104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:21.577863 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] HTTP exception thrown: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Request method failure captured: Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 HTTP/1.1 Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXTIiYuacPdHWX3E1lUHFgtQMijXcnvYw2JPcLtOPfV0_8pb7xj0ucDbp_9bewf8RR6-2tLzGiEY2eT4t3YmlZaOLBdmNGbwzGTQegnkpIG3pZ1vlOHdUn6nHD8yhIwJxev9CCD8M6pemSPIummUMUgE23ZTfi090IlCTFtJxzWLb0 Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:26:21.579510 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c4807ce933f14af0be22dd1cf3635c2f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 206ca9f278fc47e4a9a4f720083e91f3 Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.581103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'ffef349a-ea09-44f9-9cd1-cf5d9b905e50'} Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:26:21.582250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. Jun 24 15:26:21.583821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:21.585360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Returning 404 to user: Instance ffef349a-ea09-44f9-9cd1-cf5d9b905e50 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:26:21.585360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-63f4262c-f2ff-4491-ae7b-47ae833a15d6 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50" status: 404 len: 111 microversion: 2.20 time: 0.029353 Jun 24 15:26:21.585360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 418/823] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:26:21 2022] GET /compute/v2.1/servers/ffef349a-ea09-44f9-9cd1-cf5d9b905e50 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:26:22.889604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:22.890129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:22.896594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:22.897030 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:22.897788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:22.898226 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:22.911854 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] HTTP exception thrown: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Request method failure captured: Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c HTTP/1.1 Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdXTIiYuacPdHWX3E1lUHFgtQMijXcnvYw2JPcLtOPfV0_8pb7xj0ucDbp_9bewf8RR6-2tLzGiEY2eT4t3YmlZaOLBdmNGbwzGTQegnkpIG3pZ1vlOHdUn6nHD8yhIwJxev9CCD8M6pemSPIummUMUgE23ZTfi090IlCTFtJxzWLb0 Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:26:22.913384 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c4807ce933f14af0be22dd1cf3635c2f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 206ca9f278fc47e4a9a4f720083e91f3 Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.915069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'e24b4aae-8cee-48cc-bf18-e9a915ea3f2c'} Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:26:22.916092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.917786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.919239 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Returning 404 to user: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:26:22.919239 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f87a7a70-0f13-40ba-8258-06ac14a8eaf7 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 404 len: 111 microversion: 2.20 time: 0.030005 Jun 24 15:26:22.919239 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 406/824] 10.222.0.67 () {60 vars in 1279 bytes} [Fri Jun 24 15:26:22 2022] DELETE /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:26:22.924143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:22.924751 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] [instance: e24b4aae-8cee-48cc-bf18-e9a915ea3f2c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:22.930983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:22.934002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:22.934002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:22.934002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:22.949311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] HTTP exception thrown: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Request method failure captured: Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c HTTP/1.1 Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdXTIiYuacPdHWX3E1lUHFgtQMijXcnvYw2JPcLtOPfV0_8pb7xj0ucDbp_9bewf8RR6-2tLzGiEY2eT4t3YmlZaOLBdmNGbwzGTQegnkpIG3pZ1vlOHdUn6nHD8yhIwJxev9CCD8M6pemSPIummUMUgE23ZTfi090IlCTFtJxzWLb0 Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:26:22.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c4807ce933f14af0be22dd1cf3635c2f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c4807ce933f14af0be22dd1cf3635c2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: c4807ce933f14af0be22dd1cf3635c2f Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-991284910 Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 206ca9f278fc47e4a9a4f720083e91f3 Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-991284910-project Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.952533 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'e24b4aae-8cee-48cc-bf18-e9a915ea3f2c'} Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:26:22.953433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. Jun 24 15:26:22.954960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:26:22.956353 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] Returning 404 to user: Instance e24b4aae-8cee-48cc-bf18-e9a915ea3f2c could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:26:22.956353 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4d09d40f-8185-41a2-8bf7-927712485c18 tempest-AttachVolumeShelveTestJSON-991284910 tempest-AttachVolumeShelveTestJSON-991284910-project] 10.222.0.67 "GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c" status: 404 len: 111 microversion: 2.20 time: 0.033030 Jun 24 15:26:22.956353 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 419/825] 10.222.0.67 () {60 vars in 1276 bytes} [Fri Jun 24 15:26:22 2022] GET /compute/v2.1/servers/e24b4aae-8cee-48cc-bf18-e9a915ea3f2c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:26:33.525498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=12 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:33.527281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=20 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:33.640227 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-61c53037-d898-4eb8-964a-01c4c9b6ba24 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'create', calling method: .version_select at 0x7f18b1f7faf0>, body: {"keypair": {"name": "tempest-keypair-1909178311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZgDVBUXvdRz3vC3fy3UsuUGD10/wyD+Py3bPbziwH//nfqQRI0d95ubPWUkVWoVP5jstEuttQLKsz+FUCA62eEn8ToU83QNiPeqAofnRfOibnVKXK5qsaoZZgsTadL0g=="}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:26:33.655299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-61c53037-d898-4eb8-964a-01c4c9b6ba24 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for project 9c5f325c1c3245fa88dbb36698037138. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:26:33.659123 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-61c53037-d898-4eb8-964a-01c4c9b6ba24 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for user f418500a1fa84bff9e3b41c45a0bc643 and project 9c5f325c1c3245fa88dbb36698037138. Resources: {'key_pairs'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:26:33.733612 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-61c53037-d898-4eb8-964a-01c4c9b6ba24 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.213231 Jun 24 15:26:33.734217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 407/826] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:26:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:26:35.989112 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2028757098", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a938b282-cfea-4809-a5ee-a9f6a9bd6a63"}], "security_groups": [{"name": "tempest-securitygroup--43687834"}], "key_name": "tempest-keypair-1909178311", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:26:35.996238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:35.996894 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:36.098395 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] validate_networks() for [('a938b282-cfea-4809-a5ee-a9f6a9bd6a63', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:26:36.533348 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:26:36.533774 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:26:36.534623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:26:36.535284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:26:36.535866 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:26:36.549781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:36.549781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:36.549781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:36.549781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:36.566837 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for project 9c5f325c1c3245fa88dbb36698037138. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:26:36.570986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for user f418500a1fa84bff9e3b41c45a0bc643 and project 9c5f325c1c3245fa88dbb36698037138. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:26:36.588183 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:26:36.590554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:26:36.718728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4e58b927-faa5-4e4c-97f7-9d2009d7dfd5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.734168 Jun 24 15:26:36.722687 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 420/827] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:26:35 2022] POST /compute/v2.1/servers => generated 400 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:26:36.730566 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-60bea681-1a01-4946-8f39-500d04ffba94 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:36.731212 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-60bea681-1a01-4946-8f39-500d04ffba94 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:36.799660 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-60bea681-1a01-4946-8f39-500d04ffba94 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:36.808489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-60bea681-1a01-4946-8f39-500d04ffba94 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1238 microversion: 2.1 time: 0.082114 Jun 24 15:26:36.809345 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 408/828] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:36 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:37.826427 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:37.827016 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:37.833236 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:37.833679 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:37.834629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:37.835062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:37.899480 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:37.907686 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ee485a19-ab2f-401a-b654-c38f140d0fdc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1242 microversion: 2.1 time: 0.086166 Jun 24 15:26:37.908260 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 421/829] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:37 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:38.924736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:38.925277 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:38.932226 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:38.932681 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:38.933446 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:38.933882 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:38.994541 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:39.003342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9aa98ee0-57c6-4e50-b905-20b7b7d0ebb5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1298 microversion: 2.1 time: 0.082434 Jun 24 15:26:39.004121 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 409/830] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:38 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:40.021207 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:40.021827 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:40.029895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:40.030403 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:40.031217 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:40.031684 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:40.165323 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:40.178442 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-28f9bb10-2e8f-4606-b87a-2e18a838c59a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1362 microversion: 2.1 time: 0.161555 Jun 24 15:26:40.179023 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 422/831] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:40 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:40.458020 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-ff74880b-40fe-4726-961b-d85c630dd006 req-d908d3cf-3491-42ef-8a42-7763e8f126d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d75a5d-2323-4651-baaf-362175902937", "tag": "f7a751d8-c6fd-4d16-b565-3302931d702a"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:26:40.467903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-ff74880b-40fe-4726-961b-d85c630dd006 req-d908d3cf-3491-42ef-8a42-7763e8f126d3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:40.468961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-ff74880b-40fe-4726-961b-d85c630dd006 req-d908d3cf-3491-42ef-8a42-7763e8f126d3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:40.485991 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-ff74880b-40fe-4726-961b-d85c630dd006 req-d908d3cf-3491-42ef-8a42-7763e8f126d3 service nova] Creating event network-changed:f7a751d8-c6fd-4d16-b565-3302931d702a for instance e1d75a5d-2323-4651-baaf-362175902937 on hv-cinder-83538 Jun 24 15:26:40.491268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-ff74880b-40fe-4726-961b-d85c630dd006 req-d908d3cf-3491-42ef-8a42-7763e8f126d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038118 Jun 24 15:26:40.491882 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 410/832] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:26:41.196121 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:41.196723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:41.203860 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:41.204302 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:41.205093 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:41.205523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:41.336587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:41.344824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1bca2ae2-0f6a-47e9-9963-ffb574d9a9a4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1362 microversion: 2.1 time: 0.152617 Jun 24 15:26:41.345393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 423/833] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:41 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:42.362805 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:42.363532 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:42.370319 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:42.370771 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:42.371577 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:42.372044 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:42.500955 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:42.508233 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d0a7ba9b-d7d9-4191-8157-83a680966299 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1362 microversion: 2.1 time: 0.149703 Jun 24 15:26:42.508808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 411/834] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:42 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:43.525986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:43.526612 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:43.534681 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:43.535053 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:43.535869 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:43.536304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:43.674657 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:43.682641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-502b5d1c-d47a-40c6-a338-684dd4378a57 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1362 microversion: 2.1 time: 0.160786 Jun 24 15:26:43.683284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 424/835] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:43 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:44.699786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:44.700396 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:44.707070 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:44.707551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:44.708313 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:44.708754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:44.843293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:44.850605 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a80a6ddb-01be-48a5-8bf3-fe39e4eb412a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1362 microversion: 2.1 time: 0.154640 Jun 24 15:26:44.851163 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 412/836] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:44 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:26:44.965599 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-4dfdb8ef-38f1-4177-87b8-37089beab77c req-4854cc0b-4a22-4b20-8245-f30752e857c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d75a5d-2323-4651-baaf-362175902937", "name": "network-vif-plugged", "status": "completed", "tag": "f7a751d8-c6fd-4d16-b565-3302931d702a"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:26:44.975516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4dfdb8ef-38f1-4177-87b8-37089beab77c req-4854cc0b-4a22-4b20-8245-f30752e857c3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:44.975958 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-4dfdb8ef-38f1-4177-87b8-37089beab77c req-4854cc0b-4a22-4b20-8245-f30752e857c3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:44.987421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-4dfdb8ef-38f1-4177-87b8-37089beab77c req-4854cc0b-4a22-4b20-8245-f30752e857c3 service nova] Creating event network-vif-plugged:f7a751d8-c6fd-4d16-b565-3302931d702a for instance e1d75a5d-2323-4651-baaf-362175902937 on hv-cinder-83538 Jun 24 15:26:44.992494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-4dfdb8ef-38f1-4177-87b8-37089beab77c req-4854cc0b-4a22-4b20-8245-f30752e857c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031078 Jun 24 15:26:44.993078 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 425/837] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:26:45.868164 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:45.868797 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:45.875266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:45.879758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:45.879758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:45.879758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:46.007084 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:46.014537 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f825b903-8180-48a6-a56d-894bc05536d5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1362 microversion: 2.1 time: 0.150154 Jun 24 15:26:46.015521 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 413/838] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:45 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:47.029830 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:47.031464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:47.035488 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:47.039581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:47.042309 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:47.042762 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:47.043550 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:47.043991 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:47.180576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:26:47.187968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-79bea7ea-be6a-45f7-92ae-3a4989b9a70c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1548 microversion: 2.1 time: 0.159563 Jun 24 15:26:47.188523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 426/839] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:26:47 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:26:47.204514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-950158a7-8d54-488c-9cb9-65b18c996256 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:26:47.205026 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-950158a7-8d54-488c-9cb9-65b18c996256 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:26:47.206868 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:47.212332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-950158a7-8d54-488c-9cb9-65b18c996256 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:47.212789 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-950158a7-8d54-488c-9cb9-65b18c996256 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:47.213558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-950158a7-8d54-488c-9cb9-65b18c996256 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:47.214000 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-950158a7-8d54-488c-9cb9-65b18c996256 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:47.290782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-950158a7-8d54-488c-9cb9-65b18c996256 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090526 Jun 24 15:26:47.291419 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 414/840] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:26:47 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:26:48.513423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-53ae727d-81f8-4eb3-bf0a-be4dac728fcb req-d37b194a-872b-4185-be9d-70fa61096fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d75a5d-2323-4651-baaf-362175902937", "tag": "f7a751d8-c6fd-4d16-b565-3302931d702a"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:26:48.522346 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-53ae727d-81f8-4eb3-bf0a-be4dac728fcb req-d37b194a-872b-4185-be9d-70fa61096fa5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:26:48.522782 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-53ae727d-81f8-4eb3-bf0a-be4dac728fcb req-d37b194a-872b-4185-be9d-70fa61096fa5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:26:48.534666 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-53ae727d-81f8-4eb3-bf0a-be4dac728fcb req-d37b194a-872b-4185-be9d-70fa61096fa5 service nova] Creating event network-changed:f7a751d8-c6fd-4d16-b565-3302931d702a for instance e1d75a5d-2323-4651-baaf-362175902937 on hv-cinder-83538 Jun 24 15:26:48.540125 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-53ae727d-81f8-4eb3-bf0a-be4dac728fcb req-d37b194a-872b-4185-be9d-70fa61096fa5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030307 Jun 24 15:26:48.540708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 427/841] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:01.547814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:01.548589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=30 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:01.552412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:01.552918 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:01.558607 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:01.559052 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:01.559834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:01.560261 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:01.587775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:27:01.893860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d1a90af4-a38c-4356-851f-7df04f56a345 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 204 len: 0 microversion: 2.1 time: 0.347284 Jun 24 15:27:01.894514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 415/842] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:27:01 2022] DELETE /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:27:01.900852 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:01.901603 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=36 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:01.905750 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:01.906486 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:01.912677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:01.913122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:01.913880 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:01.914345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:02.136163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:02.143756 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-71b76a7c-fee8-4c05-97b0-4c18c0f06d49 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1577 microversion: 2.1 time: 0.244473 Jun 24 15:27:02.144325 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 428/843] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:01 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:02.847446 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:02.850666 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:02.856278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-eb54d488-da5a-41d9-afa5-75c91825ff49 req-87c2d862-c49f-4c7f-9a67-ff0e3403a3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa864c2-63a6-4aa7-8ea6-3ce12daff080", "tag": "e9c0e7f6-a572-47c4-8390-be9bdb776041"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:02.863120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:02.863588 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:02.864357 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:02.864792 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:02.880435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-eb54d488-da5a-41d9-afa5-75c91825ff49 req-87c2d862-c49f-4c7f-9a67-ff0e3403a3d1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:02.881232 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-eb54d488-da5a-41d9-afa5-75c91825ff49 req-87c2d862-c49f-4c7f-9a67-ff0e3403a3d1 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:02.893749 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-eb54d488-da5a-41d9-afa5-75c91825ff49 req-87c2d862-c49f-4c7f-9a67-ff0e3403a3d1 service nova] Creating event network-changed:e9c0e7f6-a572-47c4-8390-be9bdb776041 for instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 on hv-cinder-83538 Jun 24 15:27:02.894131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:27:02.900819 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-eb54d488-da5a-41d9-afa5-75c91825ff49 req-87c2d862-c49f-4c7f-9a67-ff0e3403a3d1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048369 Jun 24 15:27:02.901678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 429/844] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:03.164470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:03.165294 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:03.172664 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:03.173631 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:03.174604 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:03.175248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:03.184905 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7041561d-8172-4752-acf3-5c578d78bddf tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 204 len: 0 microversion: 2.1 time: 0.341998 Jun 24 15:27:03.185495 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 416/845] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:27:02 2022] DELETE /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:27:03.196287 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:03.197154 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:03.204067 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:03.204530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:03.205863 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:03.206008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:03.395954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:03.401554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:03.404323 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0b0f5361-2aff-43e4-a058-85a85736cf63 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1577 microversion: 2.1 time: 0.245444 Jun 24 15:27:03.405327 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 430/846] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:03 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:03.419357 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-66dc5750-92cc-47d7-8ffb-9d27bcb58553 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.228245 Jun 24 15:27:03.419932 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 417/847] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:03 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:04.422727 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:04.423382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:04.429918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:04.430372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:04.431140 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:04.431607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:04.437016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:04.437784 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:04.444550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:04.445030 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:04.445802 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:04.446245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:04.630956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:04.636079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:04.639204 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dcbf3b3f-e5b9-4a0a-89fb-90c3fac27155 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1577 microversion: 2.1 time: 0.220447 Jun 24 15:27:04.639953 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 431/848] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:04 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:04.644264 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-35166d08-07fc-4f19-987c-7e32d5b94990 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1566 microversion: 2.1 time: 0.210941 Jun 24 15:27:04.645229 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 418/849] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:04 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:27:05.657286 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:05.657897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:05.662073 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:05.662720 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:05.664788 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:05.665248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:05.666026 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:05.666468 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:05.671053 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:05.674135 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:05.674135 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:05.674135 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:05.778559 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:05.787575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-54020899-a4c3-45c2-bde6-14034eeb7e55 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1510 microversion: 2.1 time: 0.134761 Jun 24 15:27:05.788221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 432/850] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:05 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1510 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:05.814879 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:05.822785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ff216bc7-8e8f-4e9b-b806-45cb425aab56 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1382 microversion: 2.1 time: 0.164498 Jun 24 15:27:05.823402 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 419/851] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:05 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1382 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:05.861374 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-f5256bf3-b1dc-417f-8ec4-a6b28f6aa0b3 req-81c1a733-ac1c-4db3-a0cf-d69712d034ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa864c2-63a6-4aa7-8ea6-3ce12daff080", "name": "network-vif-deleted", "tag": "e9c0e7f6-a572-47c4-8390-be9bdb776041"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:05.870628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f5256bf3-b1dc-417f-8ec4-a6b28f6aa0b3 req-81c1a733-ac1c-4db3-a0cf-d69712d034ab service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:05.871072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f5256bf3-b1dc-417f-8ec4-a6b28f6aa0b3 req-81c1a733-ac1c-4db3-a0cf-d69712d034ab service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:05.895086 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-f5256bf3-b1dc-417f-8ec4-a6b28f6aa0b3 req-81c1a733-ac1c-4db3-a0cf-d69712d034ab service nova] Creating event network-vif-deleted:e9c0e7f6-a572-47c4-8390-be9bdb776041 for instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 on hv-cinder-83538 Jun 24 15:27:05.901163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-f5256bf3-b1dc-417f-8ec4-a6b28f6aa0b3 req-81c1a733-ac1c-4db3-a0cf-d69712d034ab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043707 Jun 24 15:27:05.901944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 433/852] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:06.805383 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:06.805998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:06.813807 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:06.814464 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:06.815386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:06.815889 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:06.840621 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:06.841312 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:06.848897 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:06.849388 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:06.850140 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:06.850593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:06.852413 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:06.853274 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:06.856193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lazy-loading 'fault' on Instance uuid dcc17ccb-c0b1-4819-9051-e715458f4529 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:27:06.896886 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:06.900846 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:06.902918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lazy-loading 'fault' on Instance uuid 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:27:06.913943 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:06.925106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-376e5d22-3636-49d3-9fb0-d9605546cae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1231 microversion: 2.1 time: 0.123587 Jun 24 15:27:06.926085 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 420/853] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:06 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1231 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:06.957242 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb55f38fa3c741cbb7f00e310368a85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66edbd777b48472b8fcd5a3f43c68dcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:06.967787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-670774bd-0a0f-47f9-8392-6b49120214e1 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 200 len: 1225 microversion: 2.1 time: 0.131314 Jun 24 15:27:06.969351 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 434/854] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:06 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:27:07.931803 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-4aed0e60-5a23-456a-bc2d-2573f5de5cb3 req-8834728e-4bf2-40bb-8edf-59903fdfd960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc17ccb-c0b1-4819-9051-e715458f4529", "name": "network-vif-deleted", "tag": "e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:07.940431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4aed0e60-5a23-456a-bc2d-2573f5de5cb3 req-8834728e-4bf2-40bb-8edf-59903fdfd960 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:07.940868 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-4aed0e60-5a23-456a-bc2d-2573f5de5cb3 req-8834728e-4bf2-40bb-8edf-59903fdfd960 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:07.942503 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:07.943213 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:07.949334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:07.949858 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:07.950701 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:07.951231 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:07.952056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-4aed0e60-5a23-456a-bc2d-2573f5de5cb3 req-8834728e-4bf2-40bb-8edf-59903fdfd960 service nova] Creating event network-vif-deleted:e48d9ccf-b4c4-4fdc-b2c9-817fca3f65dc for instance dcc17ccb-c0b1-4819-9051-e715458f4529 on hv-cinder-83538 Jun 24 15:27:07.957744 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-4aed0e60-5a23-456a-bc2d-2573f5de5cb3 req-8834728e-4bf2-40bb-8edf-59903fdfd960 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029428 Jun 24 15:27:07.958319 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 421/855] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:07.985123 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:07.985700 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:07.986260 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lazy-loading 'fault' on Instance uuid dcc17ccb-c0b1-4819-9051-e715458f4529 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:27:07.991978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:07.992917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] [instance: 9aa864c2-63a6-4aa7-8ea6-3ce12daff080] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:07.999869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:08.001393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:08.001393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:08.001805 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:08.016373 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] HTTP exception thrown: Instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 could not be found. Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Request method failure captured: Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 HTTP/1.1 Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdZkFnM-pDJMkvwlKT6R-tjFHy1DABFdQu5CvKZKP0gWdwf_IGfFryxv4P1uuX3afgDCjRgpyBwXxPbF5cZuoL15tCSq2_FZLDzHGIYRPj1yRKw7GNPQ651v9tDeIdJR1fl36F4QEaNcxXGF_y4a_mCutxCECyfRO8Ca5X4VmB2Cx9U Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 66edbd777b48472b8fcd5a3f43c68dcc Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-TestShelveInstance-479722578 Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:27:08.018101 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66edbd777b48472b8fcd5a3f43c68dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66edbd777b48472b8fcd5a3f43c68dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66edbd777b48472b8fcd5a3f43c68dcc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66edbd777b48472b8fcd5a3f43c68dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-TestShelveInstance-479722578 Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 66edbd777b48472b8fcd5a3f43c68dcc Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-TestShelveInstance-479722578 Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-TestShelveInstance-479722578-project Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: bb55f38fa3c741cbb7f00e310368a85b Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-TestShelveInstance-479722578-project Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 could not be found. Jun 24 15:27:08.019786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '9aa864c2-63a6-4aa7-8ea6-3ce12daff080'} Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 could not be found. Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:27:08.020873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 could not be found. Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 could not be found. Jun 24 15:27:08.022230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:27:08.023830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Returning 404 to user: Instance 9aa864c2-63a6-4aa7-8ea6-3ce12daff080 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:27:08.023830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ca717f41-7765-4b0d-8d8c-fef95d5e68e2 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080" status: 404 len: 111 microversion: 2.1 time: 0.033563 Jun 24 15:27:08.023830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 422/856] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:07 2022] GET /compute/v2.1/servers/9aa864c2-63a6-4aa7-8ea6-3ce12daff080 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:27:08.032434 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:08.039104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-750977c6-a731-4e58-8ba8-9430603771d6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 200 len: 1185 microversion: 2.1 time: 0.101233 Jun 24 15:27:08.039766 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 435/857] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:07 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 1185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:27:08.232788 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-21cad506-c82e-4b4e-9702-f3d011e27366 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] Calling method '.version_select at 0x7f18b20320d0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:08.315755 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-21cad506-c82e-4b4e-9702-f3d011e27366 tempest-TestShelveInstance-479722578 tempest-TestShelveInstance-479722578-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1293239622" status: 202 len: 0 microversion: 2.1 time: 0.086836 Jun 24 15:27:08.316337 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 423/858] 10.222.0.67 () {58 vars in 1253 bytes} [Fri Jun 24 15:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1293239622 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:27:09.055770 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:09.056386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:09.063382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:09.063832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:09.064602 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:09.065040 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:09.078069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] HTTP exception thrown: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Request method failure captured: Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 HTTP/1.1 Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdcWrNXJWIZB_pHPoiVLmtbqLIEZEIk4t9ZI4llUjeVyXbCik8MXslsQvHagyzME6llfBJmaICUfO9-WZCOkS6DynHZWtnEaIq3aFdTkK7wPx7A8yMAsdsl90Nca3tIcjrw1pBjs3yGnFn2ujDsZ_o2anmJrxduWAqUH2WjTRvMJHak Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:27:09.079784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_06aac4c0b410452fa71221434149e3b7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 6f9c73ca3c364117993dac93acf5a737 Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:27:09.081471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'dcc17ccb-c0b1-4819-9051-e715458f4529'} Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:27:09.082557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:27:09.083977 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:27:09.085138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Returning 404 to user: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:27:09.085138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8291b075-5bdb-4577-a2f1-748d972aa239 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 404 len: 111 microversion: 2.1 time: 0.029286 Jun 24 15:27:09.085138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 436/859] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:09 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:27:09.180976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-226834152", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2031902843", "security_groups": [{"name": "tempest-secgroup-smoke-313335785"}], "block_device_mapping_v2": [{"uuid": "7e57e03d-5aaf-4b27-b950-a3c3abae400d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a32a679-de41-498c-bfd0-5831dd67fdee"}]}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:09.294927 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] validate_networks() for [('2a32a679-de41-498c-bfd0-5831dd67fdee', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:27:09.951928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:27:09.952722 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:27:09.953752 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:27:09.954561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:27:09.954999 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:27:09.964075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:09.964994 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:09.965823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:09.966505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:09.984712 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for project 06aac4c0b410452fa71221434149e3b7. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:27:09.989456 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for user 6f9c73ca3c364117993dac93acf5a737 and project 06aac4c0b410452fa71221434149e3b7. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:27:10.049718 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:27:10.052032 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e57e03d-5aaf-4b27-b950-a3c3abae400d',volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:27:10.456042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-11d5798b-e606-4674-9eee-73c875fc9102 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.279305 Jun 24 15:27:10.467305 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-00c71d75-e101-454c-895e-81d30db2158d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:10.468623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-00c71d75-e101-454c-895e-81d30db2158d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:10.479440 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 424/860] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:27:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:27:10.534971 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-00c71d75-e101-454c-895e-81d30db2158d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:10.543221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-00c71d75-e101-454c-895e-81d30db2158d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1094 microversion: 2.1 time: 0.079876 Jun 24 15:27:10.544053 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 437/861] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:10 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:11.561550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:11.562167 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:11.569587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:11.570270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:11.571307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:11.571910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:11.636872 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:11.645608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a1785e2a-ed45-464e-abb1-7a3f760aad5c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1144 microversion: 2.1 time: 0.088365 Jun 24 15:27:11.646189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 425/862] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:11 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:12.662713 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:12.664039 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:12.672233 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:12.672853 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:12.673767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:12.674381 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:12.786544 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:12.794180 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-84b210b6-7c9b-4d8d-8045-0729377bae06 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1210 microversion: 2.1 time: 0.135456 Jun 24 15:27:12.794753 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 438/863] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:12 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1210 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:13.812090 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:13.812820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:13.819832 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:13.820535 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:13.821494 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:13.822096 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:14.122960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:14.122960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5296e070-33f6-4e79-95e4-12f835bb945b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.307792 Jun 24 15:27:14.122960 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 426/864] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:13 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:14.877334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-3e7b354b-6667-47b7-a1f0-415f3af1ae47 req-e7e25947-6481-46b6-b5bd-39b58a85544a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a263b760-4d15-450d-9dcb-ca7bc36eb287", "tag": "58f3591c-04bf-4951-9a65-69f9336adee7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:14.888882 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3e7b354b-6667-47b7-a1f0-415f3af1ae47 req-e7e25947-6481-46b6-b5bd-39b58a85544a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:14.889873 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-3e7b354b-6667-47b7-a1f0-415f3af1ae47 req-e7e25947-6481-46b6-b5bd-39b58a85544a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:14.908563 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-3e7b354b-6667-47b7-a1f0-415f3af1ae47 req-e7e25947-6481-46b6-b5bd-39b58a85544a service nova] Creating event network-changed:58f3591c-04bf-4951-9a65-69f9336adee7 for instance a263b760-4d15-450d-9dcb-ca7bc36eb287 on hv-cinder-83538 Jun 24 15:27:14.915471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-3e7b354b-6667-47b7-a1f0-415f3af1ae47 req-e7e25947-6481-46b6-b5bd-39b58a85544a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043733 Jun 24 15:27:14.916605 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 439/865] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:15.136792 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:15.137340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:15.148321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:15.148942 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:15.149738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:15.150184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:15.330578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:15.339474 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ae318875-5701-4bd2-af37-ee1e12e0c62a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.207875 Jun 24 15:27:15.349933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 427/866] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:15 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:16.360286 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:16.362074 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:16.367519 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:16.368502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:16.369464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:16.369910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:16.511939 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:16.519453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ae05fb05-d349-4787-884f-fe9e1242c62b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.166094 Jun 24 15:27:16.520016 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 440/867] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:16 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:17.536629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:17.537246 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:17.543907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:17.544444 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:17.545450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:17.546141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:17.732867 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:17.740738 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9a0c3be7-a51e-4fcc-973f-106ef9cf3129 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.208034 Jun 24 15:27:17.741304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 428/868] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:17 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:18.758168 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:18.758782 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:18.765536 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:18.765992 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:18.767474 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:18.768031 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:18.896624 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:18.904505 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9ba77048-3bb9-46bb-9c6a-541ab36502df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.150192 Jun 24 15:27:18.905066 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 441/869] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:18 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:19.920662 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:19.921272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:19.927895 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:19.928347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:19.929111 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:19.929551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:19.974933 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:19.996527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:20.062498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:20.069835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f8f4d272-393c-4b57-a6ae-91936227127c tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.153084 Jun 24 15:27:20.070390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 429/870] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:19 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:21.086632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:21.087269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:21.089717 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:21.095169 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:21.095638 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:21.096557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:21.096926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:21.230525 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:21.239109 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2ddc28cc-4baf-48a1-bc25-bb5ad5d125e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.156333 Jun 24 15:27:21.239814 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 442/871] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:21 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:22.256171 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:22.256817 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:22.263431 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:22.263890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:22.264657 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:22.265095 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:22.395614 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:22.399332 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:22.403573 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a0a9a3d7-7b06-4e86-bc7d-d30d15d71c41 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.151298 Jun 24 15:27:22.404166 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 430/872] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:22 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:23.421263 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:23.421873 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:23.429158 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:23.429616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:23.430495 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:23.431065 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:23.585177 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:23.592834 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1ce2ced6-fd4e-4471-81c2-995e4a5a5eeb tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.175552 Jun 24 15:27:23.593416 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 443/873] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:23 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:24.414962 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0a86609a-89f1-4c43-a4ee-4a8e0d7d93fa tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:24.415481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0a86609a-89f1-4c43-a4ee-4a8e0d7d93fa tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:24.423105 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a86609a-89f1-4c43-a4ee-4a8e0d7d93fa tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:24.423912 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a86609a-89f1-4c43-a4ee-4a8e0d7d93fa tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:24.424729 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a86609a-89f1-4c43-a4ee-4a8e0d7d93fa tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:24.425170 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0a86609a-89f1-4c43-a4ee-4a8e0d7d93fa tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:24.448446 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0a86609a-89f1-4c43-a4ee-4a8e0d7d93fa tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/ips" status: 200 len: 144 microversion: 2.1 time: 0.037292 Jun 24 15:27:24.449011 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 431/874] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:27:24 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:24.609704 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:24.610922 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:24.617535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:24.617913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:24.618758 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:24.619219 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:24.748543 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:24.756570 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6015c431-4901-41f5-a301-bf42a81300df tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.150675 Jun 24 15:27:24.757126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 444/875] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:24 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:25.171795 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-766c6d50-88d8-4ee9-a1cd-07a4ee4e946a req-2efdd21d-9d82-4703-9b48-88d1d4586bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a263b760-4d15-450d-9dcb-ca7bc36eb287", "name": "network-vif-plugged", "status": "completed", "tag": "58f3591c-04bf-4951-9a65-69f9336adee7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:25.180871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-766c6d50-88d8-4ee9-a1cd-07a4ee4e946a req-2efdd21d-9d82-4703-9b48-88d1d4586bb8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:25.181308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-766c6d50-88d8-4ee9-a1cd-07a4ee4e946a req-2efdd21d-9d82-4703-9b48-88d1d4586bb8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:25.192104 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-766c6d50-88d8-4ee9-a1cd-07a4ee4e946a req-2efdd21d-9d82-4703-9b48-88d1d4586bb8 service nova] Creating event network-vif-plugged:58f3591c-04bf-4951-9a65-69f9336adee7 for instance a263b760-4d15-450d-9dcb-ca7bc36eb287 on hv-cinder-83538 Jun 24 15:27:25.197143 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-766c6d50-88d8-4ee9-a1cd-07a4ee4e946a req-2efdd21d-9d82-4703-9b48-88d1d4586bb8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029220 Jun 24 15:27:25.197782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 432/876] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:25.773529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:25.774090 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:25.780675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:25.781212 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:25.781992 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:25.782431 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:25.912829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:25.920365 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e475ea09-4f35-47c8-8ba4-41e36ce9cb8b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.151069 Jun 24 15:27:25.920931 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 445/877] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:25 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:26.939695 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:26.940919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:26.947570 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:26.948016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:26.948772 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:26.949211 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:27.082800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:27.090379 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5e216313-f81d-48f2-bcc7-e8936f547bd4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1265 microversion: 2.1 time: 0.156065 Jun 24 15:27:27.091287 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 433/878] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:26 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:27.280594 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2897d011-17e9-4599-a36d-e70b9bb09185 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d9090f9-6358-463a-83cb-88d74852208b"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:27.282405 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2897d011-17e9-4599-a36d-e70b9bb09185 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:27.289334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2897d011-17e9-4599-a36d-e70b9bb09185 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:27.289787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2897d011-17e9-4599-a36d-e70b9bb09185 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:27.290596 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2897d011-17e9-4599-a36d-e70b9bb09185 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:27.291027 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2897d011-17e9-4599-a36d-e70b9bb09185 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:27.758161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:27.959857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2897d011-17e9-4599-a36d-e70b9bb09185 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683007 Jun 24 15:27:27.960492 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 446/879] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:27:27 2022] POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:28.107546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:28.108289 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:28.115395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:28.115852 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:28.116620 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:28.117060 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:28.248888 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:28.256427 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d0f58fa2-8064-4f7d-8218-6d7efafba40a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1451 microversion: 2.1 time: 0.152810 Jun 24 15:27:28.256987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 434/880] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:28 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:28.274265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:28.275011 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:28.281274 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:28.281893 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:28.282453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:28.283676 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:28.417091 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:28.424701 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-755a57f0-fd51-4d43-bbfd-4890a3beb28d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1451 microversion: 2.1 time: 0.155518 Jun 24 15:27:28.425271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 447/881] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:28 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:30.384299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-b7f76f8d-9906-4afd-aaa2-6e9aba5ae740 req-faabf3f7-3cc0-4bf4-8e32-633e529eb928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a263b760-4d15-450d-9dcb-ca7bc36eb287", "tag": "58f3591c-04bf-4951-9a65-69f9336adee7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:30.393426 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b7f76f8d-9906-4afd-aaa2-6e9aba5ae740 req-faabf3f7-3cc0-4bf4-8e32-633e529eb928 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:30.393875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b7f76f8d-9906-4afd-aaa2-6e9aba5ae740 req-faabf3f7-3cc0-4bf4-8e32-633e529eb928 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:30.404743 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-b7f76f8d-9906-4afd-aaa2-6e9aba5ae740 req-faabf3f7-3cc0-4bf4-8e32-633e529eb928 service nova] Creating event network-changed:58f3591c-04bf-4951-9a65-69f9336adee7 for instance a263b760-4d15-450d-9dcb-ca7bc36eb287 on hv-cinder-83538 Jun 24 15:27:30.410359 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-b7f76f8d-9906-4afd-aaa2-6e9aba5ae740 req-faabf3f7-3cc0-4bf4-8e32-633e529eb928 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029650 Jun 24 15:27:30.410972 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 435/882] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:27:35.448909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-779071c1-6191-4777-b715-57f0c0734446 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:35.451613 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=47 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:35.456608 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-779071c1-6191-4777-b715-57f0c0734446 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:35.457064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-779071c1-6191-4777-b715-57f0c0734446 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:35.518576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-779071c1-6191-4777-b715-57f0c0734446 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Going to try to stop instance {{(pid=118274) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 15:27:35.718994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-779071c1-6191-4777-b715-57f0c0734446 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action" status: 202 len: 0 microversion: 2.1 time: 0.273575 Jun 24 15:27:35.719715 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 448/883] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:27:35 2022] POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:27:35.729853 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:35.735268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:35.735268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:35.737301 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:35.737761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:35.738533 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:35.738973 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:35.871744 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:35.880624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-79725122-6475-4bb3-bb07-2486d7c50a72 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.155484 Jun 24 15:27:35.881233 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 436/884] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:35 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:36.898909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:36.899619 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:36.906340 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:36.910002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:36.910002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:36.910002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:37.039918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:37.047817 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-320b8a57-0272-48ec-aece-641343175c04 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.153406 Jun 24 15:27:37.048387 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 449/885] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:36 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:27:38.065799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:38.066389 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:38.073309 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:38.073758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:38.074527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:38.074969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:38.203518 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:38.211545 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9c242004-3fe4-4ed1-a02d-35e1d7d412e4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.150072 Jun 24 15:27:38.212109 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 437/886] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:38 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:39.228462 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:39.229101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:39.235776 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:39.236235 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:39.237272 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:39.237752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:39.367677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:39.375708 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9b4f21a5-e6cd-4300-8e07-01dab9ff4837 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.151145 Jun 24 15:27:39.376273 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 450/887] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:39 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:40.393180 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:40.393780 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:40.400739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:40.401183 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:40.401975 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:40.402412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:40.530866 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:40.539502 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8b4b366f-9b5d-419f-8dbe-4c5d85a3fbf2 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.150651 Jun 24 15:27:40.540067 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 438/888] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:40 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:41.557334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:41.557997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:41.564534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:41.565484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:41.566435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:41.566877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:41.697224 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:41.705103 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8a99d0bf-4551-4956-8db5-f0f591a4711a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.151623 Jun 24 15:27:41.705675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 451/889] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:41 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:42.722612 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:42.723263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:42.729734 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:42.730184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:42.730979 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:42.731515 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:42.856161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:42.864165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-da614e76-3bcb-4a53-8ab3-721af85950bc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.146163 Jun 24 15:27:42.864727 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 439/890] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:42 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:43.881342 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:43.881951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:43.888602 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:43.889072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:43.889834 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:43.890270 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:44.018303 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:44.026580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ae7076e7-277d-4e03-bc3d-b82370a3790d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.149172 Jun 24 15:27:44.027150 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 452/891] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:43 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:45.044690 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:45.045347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:45.052437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:45.052878 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:45.053633 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:45.054064 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:45.184047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:45.191942 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b09df456-2713-4b64-a306-470557884cd1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.151054 Jun 24 15:27:45.195499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 440/892] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:45 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:46.209252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:46.209862 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:46.216771 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:46.217229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:46.218006 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:46.218444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:46.348412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:46.356141 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-13a8e10b-7fd5-428f-ae33-d69b49a4612d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.151013 Jun 24 15:27:46.356702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 453/893] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:46 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:47.373606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:47.374149 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:47.381321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:47.381756 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:47.382520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:47.382964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:47.513071 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:47.521717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-74fae61a-48da-4df0-a3f6-c59f7d7aaeea tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.151976 Jun 24 15:27:47.522538 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 441/894] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:47 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:48.539961 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:48.540571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:48.547285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:48.547738 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:48.548539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:48.549074 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:48.676541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:48.684377 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-42e5a0bb-caf1-4b23-940b-24adb37cca2d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.148401 Jun 24 15:27:48.684934 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 454/895] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:48 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:49.701344 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:49.701956 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:49.709698 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:49.710154 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:49.710918 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:49.711398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:49.839648 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:49.848348 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-001ffb5e-5326-49d1-861b-85179999637a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.150879 Jun 24 15:27:49.848931 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 442/896] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:49 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:50.865995 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:50.866632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:50.873114 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:50.873555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:50.874311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:50.874742 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:51.006899 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:51.014847 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d4c4f22b-784e-4fe4-b994-7d94721f2900 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1721 microversion: 2.1 time: 0.153260 Jun 24 15:27:51.015441 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 455/897] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:50 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:52.031308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:52.031924 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:52.038441 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:52.038893 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:52.039681 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:52.040120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:52.168824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:52.177641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-74384cc7-47e6-4722-9d3e-6c3cf4fb74e6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1698 microversion: 2.1 time: 0.150187 Jun 24 15:27:52.178594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 443/898] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:52 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1698 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:27:52.194823 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8dd249a9-b29c-4bdb-b808-b5d03f9995bf tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:27:52.201806 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dd249a9-b29c-4bdb-b808-b5d03f9995bf tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:52.202266 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8dd249a9-b29c-4bdb-b808-b5d03f9995bf tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:52.224160 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8dd249a9-b29c-4bdb-b808-b5d03f9995bf tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Going to try to start instance {{(pid=118274) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 15:27:52.408201 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8dd249a9-b29c-4bdb-b808-b5d03f9995bf tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action" status: 202 len: 0 microversion: 2.1 time: 0.217218 Jun 24 15:27:52.408951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 456/899] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:27:52 2022] POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:27:52.417865 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:52.418479 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:52.425309 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:52.425823 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:52.426594 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:52.427028 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:52.559556 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:52.567589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-85755040-9429-4ab2-8ef7-74a290437c73 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1707 microversion: 2.1 time: 0.153804 Jun 24 15:27:52.572062 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 444/900] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:52 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:53.586821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:53.587542 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:53.593713 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:53.594163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:53.594936 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:53.595419 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:53.725135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:53.732979 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c8a4ce0a-825c-44ff-b37e-e0efd920432d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1707 microversion: 2.1 time: 0.150886 Jun 24 15:27:53.739334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 457/901] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:53 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1707 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:27:54.751038 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:27:54.752204 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:27:54.758528 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:54.758971 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:54.759753 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:27:54.760184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:27:54.888820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:27:54.898801 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-41ad9b55-63b6-4a41-950c-dcd5a4cc7247 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1711 microversion: 2.1 time: 0.151467 Jun 24 15:27:54.899418 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 445/902] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:27:54 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1711 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:28.309689 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:28.310279 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:28.312494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=19 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:28.313167 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=76,nova_cell1:INSERT=3 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:28.318311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:28.318769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:28.319628 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:28.320064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:28.401038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lazy-loading 'services' on Instance uuid e1d75a5d-2323-4651-baaf-362175902937 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:28:28.605069 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d679d26f-5c05-44bd-989d-36d40a875362 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-volume_attachments/8d9090f9-6358-463a-83cb-88d74852208b" status: 202 len: 0 microversion: 2.1 time: 0.299111 Jun 24 15:28:28.605589 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 458/903] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:28:28 2022] DELETE /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-volume_attachments/8d9090f9-6358-463a-83cb-88d74852208b => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:28:29.717106 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1cd24025-1c26-44f0-8ec7-95b2032dfbbb tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:28:29.719435 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=19 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:29.720079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=80 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:29.724840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1cd24025-1c26-44f0-8ec7-95b2032dfbbb tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:29.731851 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1cd24025-1c26-44f0-8ec7-95b2032dfbbb tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:29.785497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1cd24025-1c26-44f0-8ec7-95b2032dfbbb tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Going to try to stop instance {{(pid=118273) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 15:28:30.007902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1cd24025-1c26-44f0-8ec7-95b2032dfbbb tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action" status: 202 len: 0 microversion: 2.1 time: 0.294627 Jun 24 15:28:30.008504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 446/904] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:28:29 2022] POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:28:30.017677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:30.018437 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:30.024907 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:30.025360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:30.026128 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:30.026566 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:30.157813 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:30.166216 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a196278b-0b1f-4278-b3b7-398f8b06b13a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.153291 Jun 24 15:28:30.166799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 459/905] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:30 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:31.185243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:31.185972 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:31.192333 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:31.192782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:31.193546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:31.193988 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:31.319525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:31.326861 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3992cdd4-a0d1-4161-aaab-fcaf23492af0 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.146017 Jun 24 15:28:31.327462 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 447/906] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:31 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:32.344365 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:32.344978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:32.352175 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:32.352567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:32.353332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:32.353773 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:32.679725 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:32.687282 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a05fde81-6a2e-4d27-a6f0-9bdc51d1c85a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.346820 Jun 24 15:28:32.687851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 460/907] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:32 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:33.704232 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:33.704830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:33.711458 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:33.711908 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:33.712668 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:33.713104 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:33.840589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:33.849103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2cf21e75-c12b-4500-a111-b5045c1d1403 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.148684 Jun 24 15:28:33.849675 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 448/908] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:33 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:34.866714 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:34.867368 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:34.873900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:34.874352 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:34.875122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:34.875587 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:35.006637 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:35.014029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-42c3e518-6928-40d0-8de1-2a8ac340674b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.152146 Jun 24 15:28:35.014605 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 461/909] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:34 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:36.031333 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:36.031935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:36.038341 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:36.038781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:36.039554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:36.039987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:36.479977 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:36.488321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-51e847fd-a6b2-47cd-b704-922523abfca5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.460039 Jun 24 15:28:36.489379 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 449/910] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:36 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:37.506013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:37.506629 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:37.513091 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:37.513540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:37.514306 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:37.514742 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:37.639357 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:37.647734 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4552fc0c-0fbd-4bb9-8443-96ff7cb40e6b tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.146036 Jun 24 15:28:37.648384 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 462/911] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:37 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:38.665331 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:38.665860 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:38.672209 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:38.672652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:38.673424 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:38.673835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:38.954770 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:38.962501 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ad4ad544-12f7-4881-a62d-e2c5ecf8c769 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.301061 Jun 24 15:28:38.963056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 450/912] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:38 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:28:39.980238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:39.980828 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:39.987408 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:39.987860 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:39.988630 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:39.989063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:40.116600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:40.124318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a79f59d2-8999-4805-8d07-f3e5093182ef tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1675 microversion: 2.1 time: 0.147886 Jun 24 15:28:40.124898 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 463/913] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:39 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:41.141962 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:41.142574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:41.150377 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:41.150834 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:41.151636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:41.152076 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:41.281189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:41.288942 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0f38f7c6-d3fd-4cfe-ba33-b02bf281d6b3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1652 microversion: 2.1 time: 0.150763 Jun 24 15:28:41.289520 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 451/914] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:41 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:41.305184 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-51d5476a-6abd-40d6-a0a9-e5b4e64a3f28 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:28:41.311620 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51d5476a-6abd-40d6-a0a9-e5b4e64a3f28 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:41.312066 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-51d5476a-6abd-40d6-a0a9-e5b4e64a3f28 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:41.335332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-51d5476a-6abd-40d6-a0a9-e5b4e64a3f28 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Going to try to start instance {{(pid=118274) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 15:28:41.418060 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:28:41.418259 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:28:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action (ip 10.222.0.67) !!! Jun 24 15:28:41.515576 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-51d5476a-6abd-40d6-a0a9-e5b4e64a3f28 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action" status: 202 len: 0 microversion: 2.1 time: 0.214051 Jun 24 15:28:41.516168 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 464/915] 10.222.0.67 () {60 vars in 1277 bytes} [Fri Jun 24 15:28:41 2022] POST /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:28:41.525041 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:41.525642 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:41.531613 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:41.532900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:41.532900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:41.533261 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:41.663407 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:41.670987 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8869710d-8c44-4a65-a729-5edaa9b136b9 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1661 microversion: 2.1 time: 0.149903 Jun 24 15:28:41.671511 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 452/916] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:41 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:42.690373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:42.691083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:42.697983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:42.698435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:42.699235 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:42.699681 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:42.831710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:42.839161 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1f4a3b68-d6e2-43f9-b0c6-f1ad6ec42656 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1661 microversion: 2.1 time: 0.153563 Jun 24 15:28:42.839760 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 465/917] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:42 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:28:43.856892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:28:43.857554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:28:43.864192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:43.864717 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:43.865481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:28:43.865921 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:28:43.991565 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:28:43.998976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-073c644b-c9c4-4760-afdc-74ce77544d69 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1665 microversion: 2.1 time: 0.145990 Jun 24 15:28:43.999554 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 453/918] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:28:43 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:12.937017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1325940943", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2031902843", "security_groups": [{"name": "tempest-secgroup-smoke-313335785"}], "block_device_mapping_v2": [{"uuid": "31415181-430d-4d21-9a20-9be0cca385d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a32a679-de41-498c-bfd0-5831dd67fdee"}]}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:12.945931 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=16 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:12.946583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:13.052304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] validate_networks() for [('2a32a679-de41-498c-bfd0-5831dd67fdee', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:29:13.146959 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:29:13.147207 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:29:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.67) !!! Jun 24 15:29:13.422126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:29:13.422554 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:29:13.423029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:29:13.423465 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:29:13.423879 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:29:13.433165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:13.433616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:13.434420 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:13.434861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:13.451389 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for project 06aac4c0b410452fa71221434149e3b7. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:29:13.455225 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Getting quotas for user 6f9c73ca3c364117993dac93acf5a737 and project 06aac4c0b410452fa71221434149e3b7. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:29:13.511377 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:29:13.513462 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31415181-430d-4d21-9a20-9be0cca385d4',volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:29:14.017604 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-49703195-1697-4821-be89-9af0ce8d546a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.084317 Jun 24 15:29:14.018944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 466/919] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:29:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:29:14.029047 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c8209e21-a0ce-4161-b1ef-aff4d043972a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:14.029660 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c8209e21-a0ce-4161-b1ef-aff4d043972a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:14.031961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=16 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:14.032629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:14.089720 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c8209e21-a0ce-4161-b1ef-aff4d043972a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:14.098303 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c8209e21-a0ce-4161-b1ef-aff4d043972a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1095 microversion: 2.1 time: 0.072424 Jun 24 15:29:14.098706 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 454/920] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:14 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:15.116083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:15.116698 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:15.122796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:15.123280 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:15.124056 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:15.124494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:15.191852 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:15.197046 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b7a3cb78-545c-44d2-9637-a3429602c56e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1145 microversion: 2.1 time: 0.086119 Jun 24 15:29:15.197612 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 467/921] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:15 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:16.214137 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:16.214902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:16.223363 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:16.223820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:16.224600 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:16.225169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:16.322164 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:16.329651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f04b32b7-9c8f-47b0-b655-a2dc50e79d7d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1211 microversion: 2.1 time: 0.119668 Jun 24 15:29:16.330386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 455/922] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:16 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:17.348742 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:17.349301 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:17.355971 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.356426 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.357205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.357643 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.540817 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3e185879-582a-486d-bb8b-3010cbd56dac tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:17.541785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3e185879-582a-486d-bb8b-3010cbd56dac tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:17.548184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e185879-582a-486d-bb8b-3010cbd56dac tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.548547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e185879-582a-486d-bb8b-3010cbd56dac tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.549775 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e185879-582a-486d-bb8b-3010cbd56dac tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.549995 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3e185879-582a-486d-bb8b-3010cbd56dac tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.579008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3e185879-582a-486d-bb8b-3010cbd56dac tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042955 Jun 24 15:29:17.579595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 456/923] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:29:17 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 15:29:17.586971 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:17.594401 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6ef99124-54c6-4f21-be6a-b59421fe66b8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.250314 Jun 24 15:29:17.594968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 468/924] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:17 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:17.649459 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:17.649459 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:17.650881 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.651378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.652151 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.652595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.679819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:29:17.742404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-f77146ee-37cd-4f48-9d8b-ae4fcb26f29c req-e601b12f-c5d3-4f00-a4f2-ed202ec1fe0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aadec7f-938e-4148-99c6-c0e1282ae85c", "tag": "1345e201-cc6d-4325-8f93-49d81f6f21a7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:17.750940 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f77146ee-37cd-4f48-9d8b-ae4fcb26f29c req-e601b12f-c5d3-4f00-a4f2-ed202ec1fe0b service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.751413 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f77146ee-37cd-4f48-9d8b-ae4fcb26f29c req-e601b12f-c5d3-4f00-a4f2-ed202ec1fe0b service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.763783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-f77146ee-37cd-4f48-9d8b-ae4fcb26f29c req-e601b12f-c5d3-4f00-a4f2-ed202ec1fe0b service nova] Creating event network-changed:1345e201-cc6d-4325-8f93-49d81f6f21a7 for instance 3aadec7f-938e-4148-99c6-c0e1282ae85c on hv-cinder-83538 Jun 24 15:29:17.769165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-f77146ee-37cd-4f48-9d8b-ae4fcb26f29c req-e601b12f-c5d3-4f00-a4f2-ed202ec1fe0b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030413 Jun 24 15:29:17.775630 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 469/925] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:29:17.959815 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fddcd6db-55ff-40aa-863b-2a30a8bbc784 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 204 len: 0 microversion: 2.1 time: 0.319882 Jun 24 15:29:17.960421 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 457/926] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:29:17 2022] DELETE /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:29:17.969124 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:17.969830 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:17.977083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.977601 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:17.978423 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:17.978864 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:18.142687 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:18.151234 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0623a0e4-08ab-48a7-94d1-eeb17084d275 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1671 microversion: 2.1 time: 0.186409 Jun 24 15:29:18.151805 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 470/927] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:17 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:18.613591 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:18.614293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:18.620774 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:18.621229 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:18.621999 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:18.622437 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:18.754229 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:18.761601 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0feaed39-da64-4f79-a617-830b77b99eb4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.153116 Jun 24 15:29:18.762155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 458/928] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:18 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:29:19.168261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:19.168864 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:19.175516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:19.175959 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:19.176714 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:19.177145 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:19.304705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:19.312150 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-93544bdb-e82e-4c39-9d3d-5924120c2423 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1671 microversion: 2.1 time: 0.147758 Jun 24 15:29:19.312710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 471/929] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:19 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:19.778210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:19.778958 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:19.787031 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:19.787515 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:19.788328 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:19.788769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:19.931016 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:19.938495 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d7e8510c-2076-4c0c-86ec-374dc24428d1 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.164466 Jun 24 15:29:19.939055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 459/930] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:19 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:20.331763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:20.332425 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:20.338851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:20.339336 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:20.340117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:20.340547 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:20.566189 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:20.573753 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aaf4c839-18e2-496b-a674-8ae28c523cbc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1671 microversion: 2.1 time: 0.247649 Jun 24 15:29:20.574324 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 472/931] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:20 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1671 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:20.955689 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:20.956339 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:20.962679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:20.963136 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:20.963938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:20.964379 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:21.389361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-81d7e0a7-23d2-4d27-b837-e30d507b167e req-3de0b3dc-7587-407f-8e7b-7067053223df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d75a5d-2323-4651-baaf-362175902937", "name": "network-vif-deleted", "tag": "f7a751d8-c6fd-4d16-b565-3302931d702a"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:21.399275 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-81d7e0a7-23d2-4d27-b837-e30d507b167e req-3de0b3dc-7587-407f-8e7b-7067053223df service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:21.399728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-81d7e0a7-23d2-4d27-b837-e30d507b167e req-3de0b3dc-7587-407f-8e7b-7067053223df service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:21.412380 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-81d7e0a7-23d2-4d27-b837-e30d507b167e req-3de0b3dc-7587-407f-8e7b-7067053223df service nova] Creating event network-vif-deleted:f7a751d8-c6fd-4d16-b565-3302931d702a for instance e1d75a5d-2323-4651-baaf-362175902937 on hv-cinder-83538 Jun 24 15:29:21.414234 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:21.417710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-81d7e0a7-23d2-4d27-b837-e30d507b167e req-3de0b3dc-7587-407f-8e7b-7067053223df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032007 Jun 24 15:29:21.418313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 473/932] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:29:21.423888 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2950484b-624b-4b10-a0ff-9bd3276c1432 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.471337 Jun 24 15:29:21.425169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 460/933] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:20 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:21.591436 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:21.592153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:21.598620 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:21.599101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:21.601438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:21.601438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:21.636718 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:21.637173 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:21.637619 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lazy-loading 'fault' on Instance uuid e1d75a5d-2323-4651-baaf-362175902937 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:29:21.682778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:21.690581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d37ef478-f56c-4e1e-b2b7-466ef756ce6c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 200 len: 1328 microversion: 2.1 time: 0.103531 Jun 24 15:29:21.691369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 474/934] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:21 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:29:22.441660 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:22.442275 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:22.448850 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:22.449303 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:22.450078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:22.450514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:22.584959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:22.592480 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-490dc6ea-3b7e-4384-bd5d-e1e8e4d0dc5e tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.155024 Jun 24 15:29:22.593035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 461/935] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:22 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:22.708060 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:22.708670 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:22.715309 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:22.715710 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:22.716494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:22.716913 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:22.730254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] HTTP exception thrown: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Request method failure captured: Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 HTTP/1.1 Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdeparVIK5XKlTm4o1Xo14IzW_Vhzrc8aD2PlEFIhVDRrzZALCPTDVZs6eX4gWSHPO7yiel7tq8CXcM_DrkEaDs_jWaIdWcCwi1twXrRZhnnUGujJFyQUWih4vUp8rXaKdvQG5n50XWE43gTHxfPBCGIiTHDkxktr1ZdleVgqCzZIyo Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:29:22.731902 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c5f325c1c3245fa88dbb36698037138", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: f418500a1fa84bff9e3b41c45a0bc643 Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:29:22.733600 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'e1d75a5d-2323-4651-baaf-362175902937'} Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:29:22.734535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:29:22.736226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:29:22.737799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Returning 404 to user: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:29:22.737799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5fac4bf1-9983-4eb0-b8a0-a70176678def tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 404 len: 111 microversion: 2.1 time: 0.030030 Jun 24 15:29:22.737799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 475/936] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:22 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:29:22.742135 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-af459ebd-bdd0-42c0-ac60-ca4445df0e65 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '.version_select at 0x7f18b1f69310>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:22.818090 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-af459ebd-bdd0-42c0-ac60-ca4445df0e65 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909178311" status: 202 len: 0 microversion: 2.1 time: 0.079567 Jun 24 15:29:22.818609 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 462/937] 10.222.0.67 () {58 vars in 1220 bytes} [Fri Jun 24 15:29:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909178311 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:29:23.589216 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e4bbe9d6-1769-48b7-8c12-0f579a164062 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'create', calling method: .version_select at 0x7f18b2b79c10>, body: {"keypair": {"name": "tempest-keypair-2010220773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODl3rP4NVkhal6pVO5mut1aOh6AyjLH1arVCXoMB09NfEtfzPpbbs+g9ALaNSFB2+f3ZbPllrtxEBPi6J1KrEklrFZ+A9y+W21vszrbqmgVnotEprDj+6J7EJfw2ssRJA=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:23.593172 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:23.593986 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:23.604555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-e4bbe9d6-1769-48b7-8c12-0f579a164062 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for project 9c5f325c1c3245fa88dbb36698037138. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:29:23.608397 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-e4bbe9d6-1769-48b7-8c12-0f579a164062 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for user f418500a1fa84bff9e3b41c45a0bc643 and project 9c5f325c1c3245fa88dbb36698037138. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:29:23.609386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:23.610027 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:23.617420 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:23.617872 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:23.618644 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:23.619078 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:23.721090 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e4bbe9d6-1769-48b7-8c12-0f579a164062 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135586 Jun 24 15:29:23.722101 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 476/938] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:29:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:29:23.756293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:23.763696 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4f436e28-917e-4b98-a7ef-9676aaba20ce tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.158150 Jun 24 15:29:23.764256 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 463/939] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:23 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:29:24.781482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:24.782712 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:24.790606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:24.791107 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:24.791910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:24.792341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:24.980051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:24.987804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e4eca935-6639-44db-9a01-2969320c688d tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.210793 Jun 24 15:29:24.988371 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 477/940] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:24 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:26.004720 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:26.005338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:26.007361 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:26.008132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-82534097", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a938b282-cfea-4809-a5ee-a9f6a9bd6a63"}], "security_groups": [{"name": "tempest-securitygroup--2033504112"}], "key_name": "tempest-keypair-2010220773", "user_data": "}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:26.013072 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:26.013524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:26.014297 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:26.014787 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:26.161491 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] validate_networks() for [('a938b282-cfea-4809-a5ee-a9f6a9bd6a63', None, None, None, None, None)] {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:29:26.213829 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:26.221284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-24b0ecb0-e19b-4be7-ac5a-1a8de4c58120 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.220467 Jun 24 15:29:26.222060 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 464/941] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:25 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:26.553614 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:29:26.554036 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:29:26.556278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:29:26.556278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:29:26.556278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:29:26.564034 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:26.564482 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:26.565998 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:26.566441 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:26.582792 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for project 9c5f325c1c3245fa88dbb36698037138. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:29:26.586864 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Getting quotas for user f418500a1fa84bff9e3b41c45a0bc643 and project 9c5f325c1c3245fa88dbb36698037138. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:29:26.598790 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:29:26.601972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:29:26.767759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6796fba9-0c4a-42dd-8411-e756820b282f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.763862 Jun 24 15:29:26.768409 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 478/942] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:29:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 15:29:26.778847 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fcd2cf2f-830b-4f3b-9615-ea434462008c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:26.779592 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fcd2cf2f-830b-4f3b-9615-ea434462008c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:26.833810 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fcd2cf2f-830b-4f3b-9615-ea434462008c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:26.840569 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fcd2cf2f-830b-4f3b-9615-ea434462008c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1236 microversion: 2.1 time: 0.065512 Jun 24 15:29:26.841125 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 465/943] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:26 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:27.238944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:27.239579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:27.246226 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:27.246669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:27.247454 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:27.247929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:27.383160 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:27.390654 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0bdc2042-b975-4488-b3ac-7c17f9530739 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.157022 Jun 24 15:29:27.391227 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 479/944] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:27 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:27.857886 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:27.858502 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:27.866116 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:27.866840 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:27.867646 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:27.868089 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:27.930112 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:27.937581 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bd750fc5-cf08-419e-b7b7-94d563deae74 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1232 microversion: 2.1 time: 0.083606 Jun 24 15:29:27.938730 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 466/945] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:27 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:28.409251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:28.411850 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:28.418679 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:28.419123 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:28.419932 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:28.420361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:28.640128 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:28.648055 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ae5abd61-f21b-451f-a0e0-b76023946cd0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.243400 Jun 24 15:29:28.648642 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 480/946] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:28 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:28.954934 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:28.956273 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:28.962516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:28.962963 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:28.963757 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:28.964188 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:29.032952 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:29.041070 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-500bce14-1c98-4535-ae03-841b36ec0de7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1294 microversion: 2.1 time: 0.090305 Jun 24 15:29:29.041626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 467/947] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:28 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:29.664703 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:29.665314 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:29.671692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:29.672143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:29.672905 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:29.673337 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:29.886572 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:29.897627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-85eb80da-a047-4a30-ac27-7ba0de8bbb28 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.233989 Jun 24 15:29:29.905158 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 481/948] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:29 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:29.926365 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-d4286b15-15e6-490e-8dcf-5972ea713fd5 req-444cb4ea-db9a-4d8d-b4cb-5cee1abe6d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aadec7f-938e-4148-99c6-c0e1282ae85c", "name": "network-vif-plugged", "status": "completed", "tag": "1345e201-cc6d-4325-8f93-49d81f6f21a7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:29.934538 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-d4286b15-15e6-490e-8dcf-5972ea713fd5 req-444cb4ea-db9a-4d8d-b4cb-5cee1abe6d14 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:29.934983 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-d4286b15-15e6-490e-8dcf-5972ea713fd5 req-444cb4ea-db9a-4d8d-b4cb-5cee1abe6d14 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:29.945995 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-d4286b15-15e6-490e-8dcf-5972ea713fd5 req-444cb4ea-db9a-4d8d-b4cb-5cee1abe6d14 service nova] Creating event network-vif-plugged:1345e201-cc6d-4325-8f93-49d81f6f21a7 for instance 3aadec7f-938e-4148-99c6-c0e1282ae85c on hv-cinder-83538 Jun 24 15:29:29.950949 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-d4286b15-15e6-490e-8dcf-5972ea713fd5 req-444cb4ea-db9a-4d8d-b4cb-5cee1abe6d14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029427 Jun 24 15:29:29.951609 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 468/949] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:29:30.057758 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:30.058358 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:30.066400 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:30.066856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:30.067784 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:30.068127 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:30.264844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:30.273571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-68343c4f-bc40-437f-8c81-87a9ff4e3154 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1362 microversion: 2.1 time: 0.219517 Jun 24 15:29:30.274160 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 482/950] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:30 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:30.456398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-95b0b2b6-7c40-4a5b-9750-1c2829f0b25f req-17f9a2f3-9848-4aeb-81bd-f005fe4bc5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ba2929-16f7-4b45-a698-e2299566a165", "tag": "3072ff83-0f72-485b-be77-46d1eb364be4"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:30.471639 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-95b0b2b6-7c40-4a5b-9750-1c2829f0b25f req-17f9a2f3-9848-4aeb-81bd-f005fe4bc5e5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:30.471969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-95b0b2b6-7c40-4a5b-9750-1c2829f0b25f req-17f9a2f3-9848-4aeb-81bd-f005fe4bc5e5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:30.483325 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-95b0b2b6-7c40-4a5b-9750-1c2829f0b25f req-17f9a2f3-9848-4aeb-81bd-f005fe4bc5e5 service nova] Creating event network-changed:3072ff83-0f72-485b-be77-46d1eb364be4 for instance 24ba2929-16f7-4b45-a698-e2299566a165 on hv-cinder-83538 Jun 24 15:29:30.489641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-95b0b2b6-7c40-4a5b-9750-1c2829f0b25f req-17f9a2f3-9848-4aeb-81bd-f005fe4bc5e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037723 Jun 24 15:29:30.490263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 469/951] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:29:30.912107 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:30.912724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:30.919470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:30.919924 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:30.920701 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:30.921149 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:31.064243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:31.071822 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-457b9264-fd81-4e7b-86a0-2cf0a98100b2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1266 microversion: 2.1 time: 0.164237 Jun 24 15:29:31.072382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 483/952] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:30 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:31.290432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:31.291049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:31.297382 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:31.297828 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:31.298620 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:31.299770 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:31.483998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:31.492296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e5b2557f-9cda-4efa-91a9-4350ac940a2f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1362 microversion: 2.1 time: 0.206124 Jun 24 15:29:31.492856 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 470/953] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:31 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:32.088904 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:32.089662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:32.096797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:32.097439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:32.098231 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:32.098668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:32.232292 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:32.239864 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-70ef270d-bf72-4121-a1c3-59a3f56caae4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1452 microversion: 2.1 time: 0.154924 Jun 24 15:29:32.240425 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 484/954] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:32 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:32.256085 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:32.256725 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:32.262681 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:32.263134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:32.263998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:32.264441 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:32.391627 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:32.400080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7b15a103-d3b6-4349-b646-4475bbc2533b tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1452 microversion: 2.1 time: 0.148371 Jun 24 15:29:32.404889 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 471/955] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:32 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:32.509127 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:32.509669 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:32.515622 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:32.519507 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:32.519507 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:32.519507 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:32.716910 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:32.725414 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1036b430-41cd-46f6-b464-39ac53fc2a3f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1362 microversion: 2.1 time: 0.220072 Jun 24 15:29:32.726760 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 485/956] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:32 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:33.742505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:33.743171 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:33.750293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:33.750754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:33.751749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:33.752543 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:33.968591 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:33.976736 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e61fb99b-8c8c-4eb2-8630-91ad59359a67 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1362 microversion: 2.1 time: 0.238124 Jun 24 15:29:33.979449 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 472/957] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:33 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:34.693029 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-31eaf0a8-a899-4361-9fdd-9e997019ffa6 req-ab240ca9-382a-4fdf-95ad-23875101c382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aadec7f-938e-4148-99c6-c0e1282ae85c", "tag": "1345e201-cc6d-4325-8f93-49d81f6f21a7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:34.701818 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-31eaf0a8-a899-4361-9fdd-9e997019ffa6 req-ab240ca9-382a-4fdf-95ad-23875101c382 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:34.702261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-31eaf0a8-a899-4361-9fdd-9e997019ffa6 req-ab240ca9-382a-4fdf-95ad-23875101c382 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:34.713619 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-31eaf0a8-a899-4361-9fdd-9e997019ffa6 req-ab240ca9-382a-4fdf-95ad-23875101c382 service nova] Creating event network-changed:1345e201-cc6d-4325-8f93-49d81f6f21a7 for instance 3aadec7f-938e-4148-99c6-c0e1282ae85c on hv-cinder-83538 Jun 24 15:29:34.718812 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-31eaf0a8-a899-4361-9fdd-9e997019ffa6 req-ab240ca9-382a-4fdf-95ad-23875101c382 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029571 Jun 24 15:29:34.719623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 486/958] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:29:34.994117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:34.994984 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:35.001808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:35.002630 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:35.003900 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:35.004453 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:35.008822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:35.206484 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:35.216236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-c77d8f26-0a45-4a97-8d8b-811aad6ec090 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1362 microversion: 2.1 time: 0.225728 Jun 24 15:29:35.216821 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 473/959] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:34 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:36.094806 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-f7a67cf6-7658-46b1-a1c1-dcd4ed342f85 req-38561ac0-c9d4-4a8f-adb6-de2668f30182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ba2929-16f7-4b45-a698-e2299566a165", "name": "network-vif-plugged", "status": "completed", "tag": "3072ff83-0f72-485b-be77-46d1eb364be4"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:36.104432 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f7a67cf6-7658-46b1-a1c1-dcd4ed342f85 req-38561ac0-c9d4-4a8f-adb6-de2668f30182 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:36.104906 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f7a67cf6-7658-46b1-a1c1-dcd4ed342f85 req-38561ac0-c9d4-4a8f-adb6-de2668f30182 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:36.108643 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=100 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:36.116512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-f7a67cf6-7658-46b1-a1c1-dcd4ed342f85 req-38561ac0-c9d4-4a8f-adb6-de2668f30182 service nova] Creating event network-vif-plugged:3072ff83-0f72-485b-be77-46d1eb364be4 for instance 24ba2929-16f7-4b45-a698-e2299566a165 on hv-cinder-83538 Jun 24 15:29:36.121268 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-f7a67cf6-7658-46b1-a1c1-dcd4ed342f85 req-38561ac0-c9d4-4a8f-adb6-de2668f30182 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034847 Jun 24 15:29:36.125609 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 487/960] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:29:36.233596 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:36.241556 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:36.248128 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:36.248515 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:36.249285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:36.249722 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:36.416776 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:36.424408 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6faa0a99-3c84-4a24-ab66-959d856e452e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1362 microversion: 2.1 time: 0.194719 Jun 24 15:29:36.424978 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 474/961] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:36 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:37.442262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:37.442958 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:37.444908 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:37.445591 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=10 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:37.451675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:37.455616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:37.455616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:37.455616 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:37.586871 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:37.594320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1c2b86f2-eb2a-47b2-abb4-095459849269 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1362 microversion: 2.1 time: 0.156732 Jun 24 15:29:37.594884 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 488/962] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:37 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:38.612650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:38.613293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:38.615146 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:38.620450 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:38.620903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:38.621671 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:38.622113 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:38.750129 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:29:38.758235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-77b062b7-ac5a-42df-9873-396f46c836bd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1549 microversion: 2.1 time: 0.150258 Jun 24 15:29:38.758796 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 475/963] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:29:38 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:29:38.774705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-97901c62-176c-4419-b3e7-9d93c533a232 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:29:38.775231 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-97901c62-176c-4419-b3e7-9d93c533a232 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:29:38.781619 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97901c62-176c-4419-b3e7-9d93c533a232 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:38.782064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97901c62-176c-4419-b3e7-9d93c533a232 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:38.782862 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97901c62-176c-4419-b3e7-9d93c533a232 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:38.783529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-97901c62-176c-4419-b3e7-9d93c533a232 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:38.859117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-97901c62-176c-4419-b3e7-9d93c533a232 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088432 Jun 24 15:29:38.859798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 489/964] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:29:38 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:29:40.065982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-b34adea0-9f77-48d4-b40b-3ec70248491b req-bf7bb814-ee85-4fde-94a7-34461ce17696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ba2929-16f7-4b45-a698-e2299566a165", "tag": "3072ff83-0f72-485b-be77-46d1eb364be4"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:29:40.074582 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b34adea0-9f77-48d4-b40b-3ec70248491b req-bf7bb814-ee85-4fde-94a7-34461ce17696 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:29:40.075019 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-b34adea0-9f77-48d4-b40b-3ec70248491b req-bf7bb814-ee85-4fde-94a7-34461ce17696 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:29:40.086608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-b34adea0-9f77-48d4-b40b-3ec70248491b req-bf7bb814-ee85-4fde-94a7-34461ce17696 service nova] Creating event network-changed:3072ff83-0f72-485b-be77-46d1eb364be4 for instance 24ba2929-16f7-4b45-a698-e2299566a165 on hv-cinder-83538 Jun 24 15:29:40.091911 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-b34adea0-9f77-48d4-b40b-3ec70248491b req-bf7bb814-ee85-4fde-94a7-34461ce17696 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029668 Jun 24 15:29:40.098082 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 476/965] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:29:48.997522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:29:48.998216 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Fri Jun 24 15:29:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:30:16.039644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:16.040397 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=10 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:16.044264 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b0b32af3-9eab-45ae-b42d-112db60ba90e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:16.044758 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b0b32af3-9eab-45ae-b42d-112db60ba90e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:16.050809 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0b32af3-9eab-45ae-b42d-112db60ba90e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:16.051332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0b32af3-9eab-45ae-b42d-112db60ba90e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:16.052113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0b32af3-9eab-45ae-b42d-112db60ba90e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:16.052560 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b0b32af3-9eab-45ae-b42d-112db60ba90e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:16.075931 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b0b32af3-9eab-45ae-b42d-112db60ba90e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/ips" status: 200 len: 146 microversion: 2.1 time: 0.037732 Jun 24 15:30:16.076500 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 490/966] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:30:16 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:17.678412 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:17.679169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=18 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:17.683429 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-58b19b20-4e44-438b-bddd-e482ddc6c83d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ad6b754-ed8a-4f22-b8b3-9aa66f112230"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:30:17.684601 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-58b19b20-4e44-438b-bddd-e482ddc6c83d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:17.692009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b19b20-4e44-438b-bddd-e482ddc6c83d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:17.695916 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b19b20-4e44-438b-bddd-e482ddc6c83d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:17.695916 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b19b20-4e44-438b-bddd-e482ddc6c83d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:17.695916 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-58b19b20-4e44-438b-bddd-e482ddc6c83d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:18.293630 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-58b19b20-4e44-438b-bddd-e482ddc6c83d tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616444 Jun 24 15:30:18.294325 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 477/967] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:30:17 2022] POST /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments => generated 194 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:25.773612 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f5f38359-4bbe-4fe5-a906-42a16518828c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:25.774539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f5f38359-4bbe-4fe5-a906-42a16518828c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:25.781852 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f5f38359-4bbe-4fe5-a906-42a16518828c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:25.782311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f5f38359-4bbe-4fe5-a906-42a16518828c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:25.783083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f5f38359-4bbe-4fe5-a906-42a16518828c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:25.783551 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f5f38359-4bbe-4fe5-a906-42a16518828c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:25.815610 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f5f38359-4bbe-4fe5-a906-42a16518828c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046488 Jun 24 15:30:25.816157 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 491/968] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:30:25 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:25.828151 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0beff30d-8888-436b-86ee-51ac4496fbfd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:25.828731 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0beff30d-8888-436b-86ee-51ac4496fbfd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:25.835534 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0beff30d-8888-436b-86ee-51ac4496fbfd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:25.835986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0beff30d-8888-436b-86ee-51ac4496fbfd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:25.836749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0beff30d-8888-436b-86ee-51ac4496fbfd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:25.837190 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0beff30d-8888-436b-86ee-51ac4496fbfd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:25.864850 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0beff30d-8888-436b-86ee-51ac4496fbfd tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/5ad6b754-ed8a-4f22-b8b3-9aa66f112230" status: 200 len: 194 microversion: 2.1 time: 0.040972 Jun 24 15:30:25.865403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 478/969] 10.222.0.67 () {58 vars in 1412 bytes} [Fri Jun 24 15:30:25 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/5ad6b754-ed8a-4f22-b8b3-9aa66f112230 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:27.434953 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e077c095-c402-4bfa-8222-964d5cbbec21 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4ff147e-6266-4761-8cfe-af94f3099135"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:30:27.436040 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e077c095-c402-4bfa-8222-964d5cbbec21 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:27.442968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e077c095-c402-4bfa-8222-964d5cbbec21 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:27.443456 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e077c095-c402-4bfa-8222-964d5cbbec21 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:27.444722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e077c095-c402-4bfa-8222-964d5cbbec21 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:27.445238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e077c095-c402-4bfa-8222-964d5cbbec21 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:28.138694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e077c095-c402-4bfa-8222-964d5cbbec21 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "POST /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707314 Jun 24 15:30:28.139330 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 492/970] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:30:27 2022] POST /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:35.628681 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-460b37f0-9268-4395-944b-0276ff6c66f4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:35.629679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-460b37f0-9268-4395-944b-0276ff6c66f4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:35.640806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-460b37f0-9268-4395-944b-0276ff6c66f4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:35.641257 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-460b37f0-9268-4395-944b-0276ff6c66f4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:35.642039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-460b37f0-9268-4395-944b-0276ff6c66f4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:35.642481 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-460b37f0-9268-4395-944b-0276ff6c66f4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:35.673243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-460b37f0-9268-4395-944b-0276ff6c66f4 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048548 Jun 24 15:30:35.673798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 479/971] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:30:35 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:35.813565 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fc85fbce-e1ac-4b0c-bd87-964c1ecb71dc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:35.814098 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fc85fbce-e1ac-4b0c-bd87-964c1ecb71dc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:35.820827 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc85fbce-e1ac-4b0c-bd87-964c1ecb71dc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:35.821275 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc85fbce-e1ac-4b0c-bd87-964c1ecb71dc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:35.822051 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc85fbce-e1ac-4b0c-bd87-964c1ecb71dc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:35.822494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fc85fbce-e1ac-4b0c-bd87-964c1ecb71dc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:35.850668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fc85fbce-e1ac-4b0c-bd87-964c1ecb71dc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/5ad6b754-ed8a-4f22-b8b3-9aa66f112230" status: 200 len: 194 microversion: 2.1 time: 0.041941 Jun 24 15:30:35.852076 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 493/972] 10.222.0.67 () {58 vars in 1412 bytes} [Fri Jun 24 15:30:35 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/5ad6b754-ed8a-4f22-b8b3-9aa66f112230 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:35.861439 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:35.861953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:35.868509 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:35.868959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:35.869719 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:35.870155 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:35.950296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lazy-loading 'services' on Instance uuid 24ba2929-16f7-4b45-a698-e2299566a165 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:30:36.128889 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2ef04fd6-88dc-475a-b273-28a81349654a tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/5ad6b754-ed8a-4f22-b8b3-9aa66f112230" status: 202 len: 0 microversion: 2.1 time: 0.271221 Jun 24 15:30:36.129505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 480/973] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:30:35 2022] DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/5ad6b754-ed8a-4f22-b8b3-9aa66f112230 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:30:37.244651 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a05df64a-7ff1-493b-98bb-999101097fc6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:37.245993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a05df64a-7ff1-493b-98bb-999101097fc6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:37.252917 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05df64a-7ff1-493b-98bb-999101097fc6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:37.253369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05df64a-7ff1-493b-98bb-999101097fc6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:37.254145 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05df64a-7ff1-493b-98bb-999101097fc6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:37.254583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a05df64a-7ff1-493b-98bb-999101097fc6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:37.284574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a05df64a-7ff1-493b-98bb-999101097fc6 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/b4ff147e-6266-4761-8cfe-af94f3099135" status: 200 len: 194 microversion: 2.1 time: 0.043896 Jun 24 15:30:37.293059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 494/974] 10.222.0.67 () {58 vars in 1412 bytes} [Fri Jun 24 15:30:37 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/b4ff147e-6266-4761-8cfe-af94f3099135 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:37.296608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:37.297197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:37.303335 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:37.303778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:37.304526 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:37.304955 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:37.388235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lazy-loading 'services' on Instance uuid 24ba2929-16f7-4b45-a698-e2299566a165 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:30:37.563259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4dc540d4-50f2-4606-977f-93781ec9fc81 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/b4ff147e-6266-4761-8cfe-af94f3099135" status: 202 len: 0 microversion: 2.1 time: 0.271799 Jun 24 15:30:37.563828 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 481/975] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:30:37 2022] DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments/b4ff147e-6266-4761-8cfe-af94f3099135 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:30:38.722513 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d9466cee-f14d-4329-b7cc-70ec6a7e3cc1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:38.723528 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d9466cee-f14d-4329-b7cc-70ec6a7e3cc1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:38.730785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9466cee-f14d-4329-b7cc-70ec6a7e3cc1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:38.731551 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9466cee-f14d-4329-b7cc-70ec6a7e3cc1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:38.732334 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9466cee-f14d-4329-b7cc-70ec6a7e3cc1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:38.732776 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d9466cee-f14d-4329-b7cc-70ec6a7e3cc1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:38.762262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d9466cee-f14d-4329-b7cc-70ec6a7e3cc1 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043763 Jun 24 15:30:38.762820 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 495/976] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:30:38 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:30:38.869606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a22d4cd1-3b91-4c1a-9908-e72c957d1ebc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:38.870656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a22d4cd1-3b91-4c1a-9908-e72c957d1ebc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:38.876895 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a22d4cd1-3b91-4c1a-9908-e72c957d1ebc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:38.877347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a22d4cd1-3b91-4c1a-9908-e72c957d1ebc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:38.878117 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a22d4cd1-3b91-4c1a-9908-e72c957d1ebc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:38.878558 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a22d4cd1-3b91-4c1a-9908-e72c957d1ebc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:38.907656 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a22d4cd1-3b91-4c1a-9908-e72c957d1ebc tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042747 Jun 24 15:30:38.908209 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 482/977] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:30:38 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:30:38.963960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:38.965379 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:38.971375 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:38.971826 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:38.972586 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:38.973018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:38.996764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:30:39.237752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-844dc074-19cf-4bfe-95b3-cdac5eea33e3 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 204 len: 0 microversion: 2.1 time: 0.277273 Jun 24 15:30:39.238269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 496/978] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:30:38 2022] DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:30:39.247209 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:39.250235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:39.253984 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:39.254439 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:39.255300 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:39.255686 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:39.390467 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:30:39.398164 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d3f7cbc5-2212-4d00-a3d1-f0ba3446eb15 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1673 microversion: 2.1 time: 0.155571 Jun 24 15:30:39.398720 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 483/979] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:30:39 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:30:40.415555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:40.416254 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:40.422755 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:40.423267 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:40.424042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:40.424470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:40.554256 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:30:40.562433 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-99f10b96-42f7-48c6-8ba3-fffb3f81e87e tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1673 microversion: 2.1 time: 0.151159 Jun 24 15:30:40.562996 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 497/980] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:30:40 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:30:41.580551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:41.581162 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:41.587785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:41.588271 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:41.589034 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:41.589488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:41.659546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:30:41.667165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-26ca35c6-33f2-4da0-ac85-d5e45fe4015f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1605 microversion: 2.1 time: 0.090642 Jun 24 15:30:41.668473 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 484/981] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:30:41 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1605 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:30:41.881166 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-f6408841-e4a1-4e7e-b9c2-57710fbda4aa req-75402bc1-8ecd-4c56-a4e5-ac895962508d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ba2929-16f7-4b45-a698-e2299566a165", "name": "network-vif-deleted", "tag": "3072ff83-0f72-485b-be77-46d1eb364be4"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:30:41.890723 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f6408841-e4a1-4e7e-b9c2-57710fbda4aa req-75402bc1-8ecd-4c56-a4e5-ac895962508d service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:41.891210 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f6408841-e4a1-4e7e-b9c2-57710fbda4aa req-75402bc1-8ecd-4c56-a4e5-ac895962508d service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:41.908049 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-f6408841-e4a1-4e7e-b9c2-57710fbda4aa req-75402bc1-8ecd-4c56-a4e5-ac895962508d service nova] Creating event network-vif-deleted:3072ff83-0f72-485b-be77-46d1eb364be4 for instance 24ba2929-16f7-4b45-a698-e2299566a165 on hv-cinder-83538 Jun 24 15:30:41.913678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-f6408841-e4a1-4e7e-b9c2-57710fbda4aa req-75402bc1-8ecd-4c56-a4e5-ac895962508d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107312 Jun 24 15:30:41.914332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 498/982] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:30:42.686226 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:42.687491 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:42.693735 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:42.694210 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:42.694972 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:42.695461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:42.726221 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:42.726610 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:42.727055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lazy-loading 'fault' on Instance uuid 24ba2929-16f7-4b45-a698-e2299566a165 {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:30:42.769170 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f418500a1fa84bff9e3b41c45a0bc643', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5f325c1c3245fa88dbb36698037138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:30:42.778279 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-26382b26-fd9a-448d-af6d-a047b6269d36 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 200 len: 1326 microversion: 2.1 time: 0.095853 Jun 24 15:30:42.779133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 485/983] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:30:42 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:30:43.797035 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:43.797742 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:43.803934 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:43.804385 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:43.805151 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:43.805594 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:43.819440 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] HTTP exception thrown: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Request method failure captured: Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 HTTP/1.1 Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdeparVIK5XKlTm4o1Xo14IzW_Vhzrc8aD2PlEFIhVDRrzZALCPTDVZs6eX4gWSHPO7yiel7tq8CXcM_DrkEaDs_jWaIdWcCwi1twXrRZhnnUGujJFyQUWih4vUp8rXaKdvQG5n50XWE43gTHxfPBCGIiTHDkxktr1ZdleVgqCzZIyo Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:30:43.821038 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c5f325c1c3245fa88dbb36698037138", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: f418500a1fa84bff9e3b41c45a0bc643 Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:43.822768 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '24ba2929-16f7-4b45-a698-e2299566a165'} Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:30:43.823775 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:43.826801 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:43.828332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Returning 404 to user: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:30:43.828332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a32ae9a5-3403-4555-8056-3692ef00ae1f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 404 len: 111 microversion: 2.1 time: 0.030360 Jun 24 15:30:43.828332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 499/984] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:30:43 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:30:43.832263 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7d4bbad0-c19d-4a80-9d48-3815399693d7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '.version_select at 0x7f18b1f0d3a0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:43.901822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7d4bbad0-c19d-4a80-9d48-3815399693d7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010220773" status: 202 len: 0 microversion: 2.1 time: 0.073240 Jun 24 15:30:43.902488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 486/985] 10.222.0.67 () {58 vars in 1220 bytes} [Fri Jun 24 15:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010220773 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:30:47.235126 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:47.235668 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:47.242143 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:47.242595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:47.243409 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:47.243851 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:47.259512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] HTTP exception thrown: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Request method failure captured: Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 HTTP/1.1 Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdeparVIK5XKlTm4o1Xo14IzW_Vhzrc8aD2PlEFIhVDRrzZALCPTDVZs6eX4gWSHPO7yiel7tq8CXcM_DrkEaDs_jWaIdWcCwi1twXrRZhnnUGujJFyQUWih4vUp8rXaKdvQG5n50XWE43gTHxfPBCGIiTHDkxktr1ZdleVgqCzZIyo Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:30:47.261048 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c5f325c1c3245fa88dbb36698037138", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: f418500a1fa84bff9e3b41c45a0bc643 Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.262696 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '24ba2929-16f7-4b45-a698-e2299566a165'} Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:30:47.263677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.265421 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.267205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Returning 404 to user: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:30:47.267205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7e0e3c22-4e89-41f4-b986-aee3b87c362f tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 404 len: 111 microversion: 2.1 time: 0.032173 Jun 24 15:30:47.267205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 500/986] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:30:47 2022] DELETE /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:30:47.271905 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:47.272516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: 24ba2929-16f7-4b45-a698-e2299566a165] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:47.279293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:47.280324 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:47.281214 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:47.281657 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:47.296673 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] HTTP exception thrown: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Request method failure captured: Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 HTTP/1.1 Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdeparVIK5XKlTm4o1Xo14IzW_Vhzrc8aD2PlEFIhVDRrzZALCPTDVZs6eX4gWSHPO7yiel7tq8CXcM_DrkEaDs_jWaIdWcCwi1twXrRZhnnUGujJFyQUWih4vUp8rXaKdvQG5n50XWE43gTHxfPBCGIiTHDkxktr1ZdleVgqCzZIyo Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:30:47.298308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c5f325c1c3245fa88dbb36698037138", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: f418500a1fa84bff9e3b41c45a0bc643 Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.306159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '24ba2929-16f7-4b45-a698-e2299566a165'} Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:30:47.307094 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. Jun 24 15:30:47.308635 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:47.310408 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Returning 404 to user: Instance 24ba2929-16f7-4b45-a698-e2299566a165 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:30:47.310408 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-96dd15dc-1de4-42e1-b21a-8dbaa4e69c0c tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165" status: 404 len: 111 microversion: 2.1 time: 0.032293 Jun 24 15:30:47.310408 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 487/987] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:30:47 2022] GET /compute/v2.1/servers/24ba2929-16f7-4b45-a698-e2299566a165 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:30:48.562940 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:48.563458 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:48.569942 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:48.570400 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:48.571225 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:48.571672 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:48.585489 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] HTTP exception thrown: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Request method failure captured: Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 HTTP/1.1 Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdeparVIK5XKlTm4o1Xo14IzW_Vhzrc8aD2PlEFIhVDRrzZALCPTDVZs6eX4gWSHPO7yiel7tq8CXcM_DrkEaDs_jWaIdWcCwi1twXrRZhnnUGujJFyQUWih4vUp8rXaKdvQG5n50XWE43gTHxfPBCGIiTHDkxktr1ZdleVgqCzZIyo Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:30:48.587018 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c5f325c1c3245fa88dbb36698037138", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: f418500a1fa84bff9e3b41c45a0bc643 Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.588658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'e1d75a5d-2323-4651-baaf-362175902937'} Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:30:48.589644 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.590967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.592961 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Returning 404 to user: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:30:48.592961 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-f1cbda6a-13ff-4e15-9d02-7f54ffe9a5b7 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 404 len: 111 microversion: 2.1 time: 0.029367 Jun 24 15:30:48.592961 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 501/988] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:30:48 2022] DELETE /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:30:48.597561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:30:48.598195 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] [instance: e1d75a5d-2323-4651-baaf-362175902937] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:30:48.600592 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:48.605477 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:48.605920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:48.606671 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:30:48.607206 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:30:48.609820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:48.620811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] HTTP exception thrown: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Request method failure captured: Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 HTTP/1.1 Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdeparVIK5XKlTm4o1Xo14IzW_Vhzrc8aD2PlEFIhVDRrzZALCPTDVZs6eX4gWSHPO7yiel7tq8CXcM_DrkEaDs_jWaIdWcCwi1twXrRZhnnUGujJFyQUWih4vUp8rXaKdvQG5n50XWE43gTHxfPBCGIiTHDkxktr1ZdleVgqCzZIyo Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:30:48.631120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c5f325c1c3245fa88dbb36698037138", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c5f325c1c3245fa88dbb36698037138"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c5f325c1c3245fa88dbb36698037138 Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1200413246 Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: f418500a1fa84bff9e3b41c45a0bc643 Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeTestJSON-1200413246-project Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.632822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'e1d75a5d-2323-4651-baaf-362175902937'} Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:30:48.633669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. Jun 24 15:30:48.635048 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:30:48.636641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] Returning 404 to user: Instance e1d75a5d-2323-4651-baaf-362175902937 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:30:48.636641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fa5771ba-9c54-4223-b772-fbfad09ed8b5 tempest-AttachVolumeTestJSON-1200413246 tempest-AttachVolumeTestJSON-1200413246-project] 10.222.0.67 "GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937" status: 404 len: 111 microversion: 2.1 time: 0.030051 Jun 24 15:30:48.636641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 488/989] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:30:48 2022] GET /compute/v2.1/servers/e1d75a5d-2323-4651-baaf-362175902937 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:30:59.694186 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:59.695969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:59.874480 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aa2ea145-f94f-4236-a99f-95a8cb551fec tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: .version_select at 0x7f18b2b2cee0>, body: {"keypair": {"name": "tempest-keypair-825990121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC9dC479zzpI2vKV+c1rbxb3F0bBVlNK4NwRy4eR7e5chcLiU+OUMC5mb4ah3E9oyltg8Fy56BGwJi13O4h8O8jntbHsXPrNVS7goHhuBSVC2SFrCBcARa6/eJ/LoV32A=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:30:59.890064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-aa2ea145-f94f-4236-a99f-95a8cb551fec tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:30:59.894445 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-aa2ea145-f94f-4236-a99f-95a8cb551fec tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:31:00.005515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aa2ea145-f94f-4236-a99f-95a8cb551fec tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.316621 Jun 24 15:31:00.006123 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 502/990] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:30:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:02.489958 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377217737", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acd35ae0-cdce-4e2a-af0f-4813fbf5ee68"}], "security_groups": [{"name": "tempest-securitygroup--1088446200"}], "key_name": "tempest-keypair-825990121", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:02.693247 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] validate_networks() for [('acd35ae0-cdce-4e2a-af0f-4813fbf5ee68', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:31:03.283313 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:31:03.283975 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:31:03.284447 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:31:03.284853 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:31:03.285268 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:31:03.294314 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:03.294831 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:03.295769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:03.296211 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:03.315919 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:31:03.319982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:31:03.333285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:31:03.335874 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:31:03.447488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-993e7fc4-77ce-4749-9865-bca2514fae15 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.972917 Jun 24 15:31:03.448127 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 489/991] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:31:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 15:31:03.457929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b274ab15-dd5d-430b-9bd1-352eadb63109 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:03.458540 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b274ab15-dd5d-430b-9bd1-352eadb63109 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:03.530280 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b274ab15-dd5d-430b-9bd1-352eadb63109 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:03.538221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b274ab15-dd5d-430b-9bd1-352eadb63109 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1240 microversion: 2.1 time: 0.084060 Jun 24 15:31:03.548478 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 503/992] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:03 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:04.557098 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:04.561597 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:04.564086 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:04.564540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:04.565343 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:04.565792 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:04.630370 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:04.639022 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-80ee95f2-63f3-4be9-90e8-cbb3fa561b78 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1244 microversion: 2.1 time: 0.086321 Jun 24 15:31:04.639641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 490/993] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:04 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:05.655666 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:05.657057 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:05.664479 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:05.665164 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:05.671229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:05.671229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:05.757084 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:05.764847 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-43fba8ef-9f2b-4547-94d2-62021f960984 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1300 microversion: 2.1 time: 0.113051 Jun 24 15:31:05.765490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 504/994] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:05 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:06.782223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:06.782858 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:06.789426 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:06.789937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:06.790711 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:06.791150 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:07.269769 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:07.277582 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bab66f84-baca-4270-8feb-3a1cd5f08787 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1366 microversion: 2.1 time: 0.499690 Jun 24 15:31:07.278235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 491/995] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:06 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:07.492529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-31ffbf78-34f8-4c43-9d63-0c3d9a85c238 req-cf845337-e38a-477d-b5da-883a68acc995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d205fe2-41b4-42a3-aca8-423d2d6ffd2d", "tag": "649a0ab1-456d-4d91-b885-d5f4eb5249e8"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:07.502835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-31ffbf78-34f8-4c43-9d63-0c3d9a85c238 req-cf845337-e38a-477d-b5da-883a68acc995 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:07.503317 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-31ffbf78-34f8-4c43-9d63-0c3d9a85c238 req-cf845337-e38a-477d-b5da-883a68acc995 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:07.521796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-31ffbf78-34f8-4c43-9d63-0c3d9a85c238 req-cf845337-e38a-477d-b5da-883a68acc995 service nova] Creating event network-changed:649a0ab1-456d-4d91-b885-d5f4eb5249e8 for instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d on hv-cinder-83538 Jun 24 15:31:07.527557 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-31ffbf78-34f8-4c43-9d63-0c3d9a85c238 req-cf845337-e38a-477d-b5da-883a68acc995 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039107 Jun 24 15:31:07.528176 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 505/996] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:08.294009 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:08.294821 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:08.301463 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:08.301910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:08.302674 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:08.303114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:08.429623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:08.437428 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e0aac003-6f0e-417d-9524-d791f3a40723 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1366 microversion: 2.1 time: 0.147394 Jun 24 15:31:08.437991 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 492/997] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:08 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:09.455320 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:09.456022 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:09.462270 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:09.462725 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:09.463516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:09.463958 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:09.606338 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:09.613794 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ed566dbd-9147-4443-9e6e-523652d8c774 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1366 microversion: 2.1 time: 0.163494 Jun 24 15:31:09.614349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 506/998] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:09 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:10.629981 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:10.630689 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:10.637178 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:10.637633 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:10.638579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:10.639359 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:10.775761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:10.783884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ede1ebfc-0ad5-4689-8d94-25de641a562b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1366 microversion: 2.1 time: 0.157859 Jun 24 15:31:10.784457 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 493/999] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:10 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:11.800662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:11.801265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:11.807936 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:11.808417 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:11.809174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:11.809609 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:11.938178 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:11.945999 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5c39d894-c3b2-41c6-956d-a130e885ad06 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1366 microversion: 2.1 time: 0.149284 Jun 24 15:31:11.946568 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 507/1000] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:11 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:31:12.581411 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-83560fce-4701-48d9-be37-4dfd7d0fab1d req-9a5465a4-9fd9-4a6d-ae61-1e319fa770df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d205fe2-41b4-42a3-aca8-423d2d6ffd2d", "name": "network-vif-plugged", "status": "completed", "tag": "649a0ab1-456d-4d91-b885-d5f4eb5249e8"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:12.589461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-83560fce-4701-48d9-be37-4dfd7d0fab1d req-9a5465a4-9fd9-4a6d-ae61-1e319fa770df service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:12.589899 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-83560fce-4701-48d9-be37-4dfd7d0fab1d req-9a5465a4-9fd9-4a6d-ae61-1e319fa770df service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:12.601348 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-83560fce-4701-48d9-be37-4dfd7d0fab1d req-9a5465a4-9fd9-4a6d-ae61-1e319fa770df service nova] Creating event network-vif-plugged:649a0ab1-456d-4d91-b885-d5f4eb5249e8 for instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d on hv-cinder-83538 Jun 24 15:31:12.606357 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-83560fce-4701-48d9-be37-4dfd7d0fab1d req-9a5465a4-9fd9-4a6d-ae61-1e319fa770df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087522 Jun 24 15:31:12.607049 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 494/1001] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:12.962952 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:12.964220 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:12.971473 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:12.971929 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:12.972705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:12.973151 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:13.101104 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:13.109598 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-58951afe-8993-452f-ab54-07dea5e6652c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1366 microversion: 2.1 time: 0.150551 Jun 24 15:31:13.110158 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 508/1002] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:12 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:14.123055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:14.124079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:14.128872 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:14.129575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:14.135704 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.136156 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.137066 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.137505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.304372 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:14.306059 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:14.309073 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:14.315396 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.316193 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.317139 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.317946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.326386 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:14.339043 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9780f994-3167-403c-b493-81ec733ca611 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1555 microversion: 2.1 time: 0.216790 Jun 24 15:31:14.349785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 495/1003] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:14 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:14.349785 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-bf887b68-74cf-4d98-b0ac-4825b1a31df1 req-5a603da9-7d2f-45a8-804a-6fc1839f28b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aadec7f-938e-4148-99c6-c0e1282ae85c", "tag": "1345e201-cc6d-4325-8f93-49d81f6f21a7"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:14.360289 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-bf887b68-74cf-4d98-b0ac-4825b1a31df1 req-5a603da9-7d2f-45a8-804a-6fc1839f28b3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.360725 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-bf887b68-74cf-4d98-b0ac-4825b1a31df1 req-5a603da9-7d2f-45a8-804a-6fc1839f28b3 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.361238 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:31:14.372814 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-bf887b68-74cf-4d98-b0ac-4825b1a31df1 req-5a603da9-7d2f-45a8-804a-6fc1839f28b3 service nova] Creating event network-changed:1345e201-cc6d-4325-8f93-49d81f6f21a7 for instance 3aadec7f-938e-4148-99c6-c0e1282ae85c on hv-cinder-83538 Jun 24 15:31:14.379910 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-bf887b68-74cf-4d98-b0ac-4825b1a31df1 req-5a603da9-7d2f-45a8-804a-6fc1839f28b3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039104 Jun 24 15:31:14.380506 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 496/1004] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:14.385966 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-830c44a6-049b-4ef0-b95b-9909c7fc2f43 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:14.386549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-830c44a6-049b-4ef0-b95b-9909c7fc2f43 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:14.394245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-830c44a6-049b-4ef0-b95b-9909c7fc2f43 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.395196 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-830c44a6-049b-4ef0-b95b-9909c7fc2f43 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.396185 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-830c44a6-049b-4ef0-b95b-9909c7fc2f43 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.396778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-830c44a6-049b-4ef0-b95b-9909c7fc2f43 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.500749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-830c44a6-049b-4ef0-b95b-9909c7fc2f43 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118843 Jun 24 15:31:14.501331 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 497/1005] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:31:14 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:14.798424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4d78e5d9-ea13-4a84-95d4-87704d9ca0c4 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 204 len: 0 microversion: 2.1 time: 0.498316 Jun 24 15:31:14.802869 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 509/1006] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:31:14 2022] DELETE /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 15:31:14.807999 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:14.808673 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:14.815440 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.816266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.817120 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:14.817627 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:14.961290 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:14.970855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1c5af5be-af53-4861-a22c-1ce1d0b402ee tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1577 microversion: 2.1 time: 0.166596 Jun 24 15:31:14.971527 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 498/1007] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:14 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:31:15.602777 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-61b2734c-199b-4cb8-9937-10c92bb05c71 req-5a8046f6-3c67-40ca-abac-62b603c4a9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d205fe2-41b4-42a3-aca8-423d2d6ffd2d", "tag": "649a0ab1-456d-4d91-b885-d5f4eb5249e8"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:15.611686 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-61b2734c-199b-4cb8-9937-10c92bb05c71 req-5a8046f6-3c67-40ca-abac-62b603c4a9d7 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:15.612138 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-61b2734c-199b-4cb8-9937-10c92bb05c71 req-5a8046f6-3c67-40ca-abac-62b603c4a9d7 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:15.624026 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-61b2734c-199b-4cb8-9937-10c92bb05c71 req-5a8046f6-3c67-40ca-abac-62b603c4a9d7 service nova] Creating event network-changed:649a0ab1-456d-4d91-b885-d5f4eb5249e8 for instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d on hv-cinder-83538 Jun 24 15:31:15.628918 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-61b2734c-199b-4cb8-9937-10c92bb05c71 req-5a8046f6-3c67-40ca-abac-62b603c4a9d7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087909 Jun 24 15:31:15.629523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 510/1008] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:15.989066 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:15.989732 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:15.996298 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:15.996749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:15.997515 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:15.997957 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:16.214306 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:16.223376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-515319bb-0080-4983-bd41-237cf21369e0 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1577 microversion: 2.1 time: 0.237989 Jun 24 15:31:16.227293 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 499/1009] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:15 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:16.973652 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-5ee38616-6a71-4cc6-ac23-354a3cc8fc79 req-1947d5fd-0708-4c5d-a863-f2ae91c9f13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aadec7f-938e-4148-99c6-c0e1282ae85c", "name": "network-vif-deleted", "tag": "1345e201-cc6d-4325-8f93-49d81f6f21a7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:16.982803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5ee38616-6a71-4cc6-ac23-354a3cc8fc79 req-1947d5fd-0708-4c5d-a863-f2ae91c9f13e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:16.983332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5ee38616-6a71-4cc6-ac23-354a3cc8fc79 req-1947d5fd-0708-4c5d-a863-f2ae91c9f13e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:16.994260 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-5ee38616-6a71-4cc6-ac23-354a3cc8fc79 req-1947d5fd-0708-4c5d-a863-f2ae91c9f13e service nova] Creating event network-vif-deleted:1345e201-cc6d-4325-8f93-49d81f6f21a7 for instance 3aadec7f-938e-4148-99c6-c0e1282ae85c on hv-cinder-83538 Jun 24 15:31:16.999497 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-5ee38616-6a71-4cc6-ac23-354a3cc8fc79 req-1947d5fd-0708-4c5d-a863-f2ae91c9f13e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030083 Jun 24 15:31:17.000084 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 511/1010] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:17.241561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:17.242134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:17.249077 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:17.249516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:17.250285 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:17.250715 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:17.581395 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:17.588795 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-310ea064-9ab4-49ff-8a53-4c16047da6de tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 200 len: 1226 microversion: 2.1 time: 0.351104 Jun 24 15:31:17.589350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 500/1011] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:17 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 1226 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:18.606349 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:18.607097 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: 3aadec7f-938e-4148-99c6-c0e1282ae85c] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:18.614020 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:18.614473 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:18.615285 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:18.615727 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:18.628932 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] HTTP exception thrown: Instance 3aadec7f-938e-4148-99c6-c0e1282ae85c could not be found. Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Request method failure captured: Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c HTTP/1.1 Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdcWrNXJWIZB_pHPoiVLmtbqLIEZEIk4t9ZI4llUjeVyXbCik8MXslsQvHagyzME6llfBJmaICUfO9-WZCOkS6DynHZWtnEaIq3aFdTkK7wPx7A8yMAsdsl90Nca3tIcjrw1pBjs3yGnFn2ujDsZ_o2anmJrxduWAqUH2WjTRvMJHak Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:31:18.630515 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_06aac4c0b410452fa71221434149e3b7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 6f9c73ca3c364117993dac93acf5a737 Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 3aadec7f-938e-4148-99c6-c0e1282ae85c could not be found. Jun 24 15:31:18.632087 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '3aadec7f-938e-4148-99c6-c0e1282ae85c'} Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aadec7f-938e-4148-99c6-c0e1282ae85c could not be found. Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:31:18.632935 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aadec7f-938e-4148-99c6-c0e1282ae85c could not be found. Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aadec7f-938e-4148-99c6-c0e1282ae85c could not be found. Jun 24 15:31:18.634607 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:18.636387 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Returning 404 to user: Instance 3aadec7f-938e-4148-99c6-c0e1282ae85c could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:31:18.636387 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-091b0002-93e6-4357-999f-ea00a21f1b74 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c" status: 404 len: 111 microversion: 2.1 time: 0.029851 Jun 24 15:31:18.636387 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 512/1012] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:18 2022] GET /compute/v2.1/servers/3aadec7f-938e-4148-99c6-c0e1282ae85c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:31:22.187342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:22.187884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:22.189811 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-a783f9ce-fa97-46ed-be78-51e8af91d38b req-285f1634-c9d2-4379-9f1d-358587d748b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a263b760-4d15-450d-9dcb-ca7bc36eb287", "tag": "58f3591c-04bf-4951-9a65-69f9336adee7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:22.194665 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:22.195114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:22.196165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:22.196603 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:22.198844 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a783f9ce-fa97-46ed-be78-51e8af91d38b req-285f1634-c9d2-4379-9f1d-358587d748b8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:22.199563 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a783f9ce-fa97-46ed-be78-51e8af91d38b req-285f1634-c9d2-4379-9f1d-358587d748b8 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:22.213149 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-a783f9ce-fa97-46ed-be78-51e8af91d38b req-285f1634-c9d2-4379-9f1d-358587d748b8 service nova] Creating event network-changed:58f3591c-04bf-4951-9a65-69f9336adee7 for instance a263b760-4d15-450d-9dcb-ca7bc36eb287 on hv-cinder-83538 Jun 24 15:31:22.219221 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-a783f9ce-fa97-46ed-be78-51e8af91d38b req-285f1634-c9d2-4379-9f1d-358587d748b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033787 Jun 24 15:31:22.219835 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 513/1013] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:22.222876 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:31:22.483721 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e5ed1bd7-839e-4f2f-927a-8be807800c37 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 204 len: 0 microversion: 2.1 time: 0.300609 Jun 24 15:31:22.484310 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 501/1014] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:31:22 2022] DELETE /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 15:31:22.493050 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:22.494436 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:22.503506 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:22.503894 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:22.506993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:22.507493 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:22.647234 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:22.656160 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-4550d0d5-73cd-45ed-a038-fe5c0b3a2c3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1576 microversion: 2.1 time: 0.167301 Jun 24 15:31:22.656778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 514/1015] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:22 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:23.674628 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:23.675359 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:23.682649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:23.685567 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:23.685567 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:23.685567 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:23.850624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:23.858543 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-26956e2e-3139-4259-b493-ff149a4aa7f8 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1576 microversion: 2.1 time: 0.188286 Jun 24 15:31:23.859112 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 502/1016] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:23 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:24.501757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-285a59ad-bc14-45c5-a0f2-d7ae6d9e22bf req-b5a570ea-b825-4644-a8d3-683ada9b7588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a263b760-4d15-450d-9dcb-ca7bc36eb287", "name": "network-vif-deleted", "tag": "58f3591c-04bf-4951-9a65-69f9336adee7"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:24.512284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-285a59ad-bc14-45c5-a0f2-d7ae6d9e22bf req-b5a570ea-b825-4644-a8d3-683ada9b7588 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:24.512284 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-285a59ad-bc14-45c5-a0f2-d7ae6d9e22bf req-b5a570ea-b825-4644-a8d3-683ada9b7588 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:24.522625 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-285a59ad-bc14-45c5-a0f2-d7ae6d9e22bf req-b5a570ea-b825-4644-a8d3-683ada9b7588 service nova] Creating event network-vif-deleted:58f3591c-04bf-4951-9a65-69f9336adee7 for instance a263b760-4d15-450d-9dcb-ca7bc36eb287 on hv-cinder-83538 Jun 24 15:31:24.527692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-285a59ad-bc14-45c5-a0f2-d7ae6d9e22bf req-b5a570ea-b825-4644-a8d3-683ada9b7588 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029763 Jun 24 15:31:24.528265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 515/1017] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:24.884411 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:24.886914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:24.902603 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:24.904626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:24.904626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:24.904626 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:24.967306 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9c73ca3c364117993dac93acf5a737', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06aac4c0b410452fa71221434149e3b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:31:24.974651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-3cea2664-d5fc-44d4-9697-a7f4ed2f6af6 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 200 len: 1225 microversion: 2.1 time: 0.103467 Jun 24 15:31:24.977616 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 503/1018] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:24 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:31:25.993375 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:25.994075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: a263b760-4d15-450d-9dcb-ca7bc36eb287] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:26.001444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:26.001901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:26.002670 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:26.003111 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:26.016315 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] HTTP exception thrown: Instance a263b760-4d15-450d-9dcb-ca7bc36eb287 could not be found. Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Request method failure captured: Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 HTTP/1.1 Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdcWrNXJWIZB_pHPoiVLmtbqLIEZEIk4t9ZI4llUjeVyXbCik8MXslsQvHagyzME6llfBJmaICUfO9-WZCOkS6DynHZWtnEaIq3aFdTkK7wPx7A8yMAsdsl90Nca3tIcjrw1pBjs3yGnFn2ujDsZ_o2anmJrxduWAqUH2WjTRvMJHak Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:31:26.017895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_06aac4c0b410452fa71221434149e3b7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 6f9c73ca3c364117993dac93acf5a737 Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance a263b760-4d15-450d-9dcb-ca7bc36eb287 could not be found. Jun 24 15:31:26.019606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'a263b760-4d15-450d-9dcb-ca7bc36eb287'} Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a263b760-4d15-450d-9dcb-ca7bc36eb287 could not be found. Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:31:26.020583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a263b760-4d15-450d-9dcb-ca7bc36eb287 could not be found. Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a263b760-4d15-450d-9dcb-ca7bc36eb287 could not be found. Jun 24 15:31:26.022174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.023653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Returning 404 to user: Instance a263b760-4d15-450d-9dcb-ca7bc36eb287 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:31:26.023653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cef8cd75-4803-4a2c-8e9c-7276c5377150 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287" status: 404 len: 111 microversion: 2.1 time: 0.030684 Jun 24 15:31:26.023653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 516/1019] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:25 2022] GET /compute/v2.1/servers/a263b760-4d15-450d-9dcb-ca7bc36eb287 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:31:26.546083 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:26.546617 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:26.553184 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:26.553667 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:26.554491 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:26.554935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:26.568254 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] HTTP exception thrown: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Request method failure captured: Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: DELETE /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 HTTP/1.1 Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdcWrNXJWIZB_pHPoiVLmtbqLIEZEIk4t9ZI4llUjeVyXbCik8MXslsQvHagyzME6llfBJmaICUfO9-WZCOkS6DynHZWtnEaIq3aFdTkK7wPx7A8yMAsdsl90Nca3tIcjrw1pBjs3yGnFn2ujDsZ_o2anmJrxduWAqUH2WjTRvMJHak Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:31:26.569938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_06aac4c0b410452fa71221434149e3b7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 6f9c73ca3c364117993dac93acf5a737 Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.571574 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'dcc17ccb-c0b1-4819-9051-e715458f4529'} Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:31:26.572530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.574010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.576058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Returning 404 to user: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:31:26.576058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4a5d52ef-405b-4c88-b8f7-af67c28d4b3a tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "DELETE /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 404 len: 111 microversion: 2.1 time: 0.030302 Jun 24 15:31:26.576058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 504/1020] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:31:26 2022] DELETE /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:31:26.580448 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:26.581056 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] [instance: dcc17ccb-c0b1-4819-9051-e715458f4529] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:26.587063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:26.587542 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:26.588304 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:26.588743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:26.602203 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] HTTP exception thrown: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Request method failure captured: Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 HTTP/1.1 Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdcWrNXJWIZB_pHPoiVLmtbqLIEZEIk4t9ZI4llUjeVyXbCik8MXslsQvHagyzME6llfBJmaICUfO9-WZCOkS6DynHZWtnEaIq3aFdTkK7wPx7A8yMAsdsl90Nca3tIcjrw1pBjs3yGnFn2ujDsZ_o2anmJrxduWAqUH2WjTRvMJHak Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:31:26.603722 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_06aac4c0b410452fa71221434149e3b7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/06aac4c0b410452fa71221434149e3b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 06aac4c0b410452fa71221434149e3b7 Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-TestVolumeBootPattern-1668829789 Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 6f9c73ca3c364117993dac93acf5a737 Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-TestVolumeBootPattern-1668829789-project Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.605404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'dcc17ccb-c0b1-4819-9051-e715458f4529'} Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:31:26.606265 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. Jun 24 15:31:26.608248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:31:26.609694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Returning 404 to user: Instance dcc17ccb-c0b1-4819-9051-e715458f4529 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:31:26.609694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7e7a2c93-933c-4a2e-9213-b55816d9bf08 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529" status: 404 len: 111 microversion: 2.1 time: 0.028494 Jun 24 15:31:26.609694 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 517/1021] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:31:26 2022] GET /compute/v2.1/servers/dcc17ccb-c0b1-4819-9051-e715458f4529 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:31:28.069883 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-079ca9cc-9b6f-4689-bf57-b536beae75f2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] Calling method '.version_select at 0x7f18b1f0a9d0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:28.152355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-079ca9cc-9b6f-4689-bf57-b536beae75f2 tempest-TestVolumeBootPattern-1668829789 tempest-TestVolumeBootPattern-1668829789-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2031902843" status: 202 len: 0 microversion: 2.1 time: 0.086152 Jun 24 15:31:28.152935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 505/1022] 10.222.0.67 () {58 vars in 1262 bytes} [Fri Jun 24 15:31:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2031902843 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 15:31:51.405993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0e1e945e-f8a9-49b2-87da-626fe4d4ea38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:31:51.406573 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0e1e945e-f8a9-49b2-87da-626fe4d4ea38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:51.408886 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:51.409595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:51.414360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e1e945e-f8a9-49b2-87da-626fe4d4ea38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:51.414807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e1e945e-f8a9-49b2-87da-626fe4d4ea38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:51.415583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e1e945e-f8a9-49b2-87da-626fe4d4ea38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:51.416014 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0e1e945e-f8a9-49b2-87da-626fe4d4ea38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:51.442718 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0e1e945e-f8a9-49b2-87da-626fe4d4ea38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/ips" status: 200 len: 149 microversion: 2.1 time: 0.039691 Jun 24 15:31:51.443360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 518/1023] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:31:51 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:31:53.142822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:53.143608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:53.147873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-47bad32b-23ce-4d1f-9de6-c6f7fc41aac4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8ac361-3609-4307-a465-6a65f5fdabfe"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:31:53.149223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-47bad32b-23ce-4d1f-9de6-c6f7fc41aac4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:31:53.155884 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47bad32b-23ce-4d1f-9de6-c6f7fc41aac4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:53.156374 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47bad32b-23ce-4d1f-9de6-c6f7fc41aac4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:53.157160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47bad32b-23ce-4d1f-9de6-c6f7fc41aac4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:31:53.157613 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-47bad32b-23ce-4d1f-9de6-c6f7fc41aac4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:31:53.800368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-47bad32b-23ce-4d1f-9de6-c6f7fc41aac4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658890 Jun 24 15:31:53.800989 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 506/1024] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:31:53 2022] POST /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:32:01.287393 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8df726f8-15f9-4160-86e6-d59281596713 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: .version_select at 0x7f18b2a7a9d0>, body: {"keypair": {"name": "tempest-keypair-1918359022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLjP9I7zJKaUuLt9bHtvcMFUn21mL3oH0yXdCjFXecx8JBq5kkd2dzQ8l3vQ57t6F9eO1x3T01WMCn1LR4dYupwJPbxB20XL7x4FrtpxbKAVqGfkXrQ9IjLTFD1NeskIA=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:32:01.302588 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-8df726f8-15f9-4160-86e6-d59281596713 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:32:01.306345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-8df726f8-15f9-4160-86e6-d59281596713 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:32:01.374255 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8df726f8-15f9-4160-86e6-d59281596713 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091700 Jun 24 15:32:01.374764 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 519/1025] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:32:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:32:01.430869 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:32:01.431085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:32:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:32:03.381568 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:03.386230 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1650768206", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acd35ae0-cdce-4e2a-af0f-4813fbf5ee68"}], "security_groups": [{"name": "tempest-securitygroup--261772472"}], "key_name": "tempest-keypair-1918359022", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:32:03.486156 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] validate_networks() for [('acd35ae0-cdce-4e2a-af0f-4813fbf5ee68', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:32:03.729852 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:03.855766 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:32:03.856189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:32:03.856663 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:32:03.857065 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:32:03.857472 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:32:03.867347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:03.867798 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:03.868621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:03.869055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:03.885443 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:32:03.889281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:32:03.902105 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:32:03.904645 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:32:04.015212 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-429f8234-bc56-4767-b529-c76e048205ac tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.635587 Jun 24 15:32:04.015825 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 507/1026] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:32:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:32:04.027551 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8d1a2824-a504-45a3-8adb-45e4b8ac232e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:04.028157 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8d1a2824-a504-45a3-8adb-45e4b8ac232e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:04.082798 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8d1a2824-a504-45a3-8adb-45e4b8ac232e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:04.091200 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8d1a2824-a504-45a3-8adb-45e4b8ac232e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1242 microversion: 2.1 time: 0.068418 Jun 24 15:32:04.091978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 520/1027] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:04 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:05.108993 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7201e0cd-34eb-4fac-962e-610f579eb286 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:05.109606 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7201e0cd-34eb-4fac-962e-610f579eb286 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:05.163223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7201e0cd-34eb-4fac-962e-610f579eb286 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:05.169770 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7201e0cd-34eb-4fac-962e-610f579eb286 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1242 microversion: 2.1 time: 0.064670 Jun 24 15:32:05.170322 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 508/1028] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:05 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:06.185470 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0e34d365-8595-4c7a-87b0-e570845a008a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:06.186083 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0e34d365-8595-4c7a-87b0-e570845a008a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:06.238229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0e34d365-8595-4c7a-87b0-e570845a008a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:06.245148 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0e34d365-8595-4c7a-87b0-e570845a008a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1242 microversion: 2.1 time: 0.063434 Jun 24 15:32:06.245715 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 521/1029] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:06 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:07.261909 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-92beffa4-33c2-458a-a5d5-176695ba500e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:07.262514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-92beffa4-33c2-458a-a5d5-176695ba500e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:07.317350 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-92beffa4-33c2-458a-a5d5-176695ba500e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:07.324033 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-92beffa4-33c2-458a-a5d5-176695ba500e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1242 microversion: 2.1 time: 0.065975 Jun 24 15:32:07.324590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 509/1030] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:07 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:08.341283 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:08.341887 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:08.348949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:08.349340 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:08.350236 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:08.350673 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:08.410535 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:08.417960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-96d6030b-3eef-4335-9c42-f69418545158 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1246 microversion: 2.1 time: 0.080506 Jun 24 15:32:08.418524 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 522/1031] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:08 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:09.434571 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:09.435281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:09.442503 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:09.442961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:09.444342 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:09.444782 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:09.506595 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:09.514222 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-13ec88fd-28e4-49bf-b107-0af803478e7d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1238 microversion: 2.1 time: 0.083598 Jun 24 15:32:09.514783 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 510/1032] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:09 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:10.538786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:10.538786 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:10.543900 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:10.544359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:10.545153 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:10.545596 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:10.630702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:10.638168 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-0f2550d0-e2e2-4ece-bc2b-7bca9e482184 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1300 microversion: 2.1 time: 0.106666 Jun 24 15:32:10.638763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 523/1033] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:10 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:11.660224 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:11.661458 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:11.668649 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-b240cf89-ce6f-4923-99c4-76d09c970119 req-41849a64-6681-4906-af0b-511aee066ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5126022-24c8-422f-8b3c-4ece0ccd41f7", "tag": "80af1f02-8a99-4862-9946-cf9408dea4db"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:32:11.671070 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:11.671800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:11.672835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:11.673641 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:11.679527 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b240cf89-ce6f-4923-99c4-76d09c970119 req-41849a64-6681-4906-af0b-511aee066ae6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:11.680602 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-b240cf89-ce6f-4923-99c4-76d09c970119 req-41849a64-6681-4906-af0b-511aee066ae6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:11.699251 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-b240cf89-ce6f-4923-99c4-76d09c970119 req-41849a64-6681-4906-af0b-511aee066ae6 service nova] Creating event network-changed:80af1f02-8a99-4862-9946-cf9408dea4db for instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 on hv-cinder-83538 Jun 24 15:32:11.704581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-b240cf89-ce6f-4923-99c4-76d09c970119 req-41849a64-6681-4906-af0b-511aee066ae6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041278 Jun 24 15:32:11.709318 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 524/1034] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:32:11.917075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:11.924389 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e85623d3-35da-4363-ab40-c75f72b1e8ce tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1367 microversion: 2.1 time: 0.272321 Jun 24 15:32:11.924972 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 511/1035] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:11 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:12.942804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:12.944300 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:12.950701 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:12.951154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:12.951972 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:12.952436 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:13.083870 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:13.092268 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1afc791c-1d71-47f1-aac3-6a963d0af28b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1367 microversion: 2.1 time: 0.154051 Jun 24 15:32:13.093084 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 525/1036] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:12 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:14.109580 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:14.110193 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:14.112505 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:14.117855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:14.118307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:14.119071 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:14.119540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:14.245461 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:14.252988 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d6574fe9-2ba4-4c3c-b563-f27b200d5dfc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1367 microversion: 2.1 time: 0.147269 Jun 24 15:32:14.253549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 512/1037] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:14 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:15.270354 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:15.270959 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:15.278739 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:15.279208 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:15.279981 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:15.280420 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:15.412598 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:15.419988 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b6a7e3ca-076f-47e8-91b2-46fe78bacd55 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1367 microversion: 2.1 time: 0.153572 Jun 24 15:32:15.420555 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 526/1038] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:15 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:16.437035 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:16.437638 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:16.444715 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:16.445158 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:16.445914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:16.446347 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:16.576341 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:16.583688 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-10e85da8-f60b-40dc-816d-151b694b1336 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1367 microversion: 2.1 time: 0.150761 Jun 24 15:32:16.584822 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 513/1039] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:16 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:16.948803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-1fde08f7-46cf-4348-8d28-cabdc7fa09ad req-17a6bb97-8d7d-483b-a9e8-efbf0e64feeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5126022-24c8-422f-8b3c-4ece0ccd41f7", "name": "network-vif-plugged", "status": "completed", "tag": "80af1f02-8a99-4862-9946-cf9408dea4db"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:32:16.952305 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=8 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:16.958043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1fde08f7-46cf-4348-8d28-cabdc7fa09ad req-17a6bb97-8d7d-483b-a9e8-efbf0e64feeb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:16.958491 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-1fde08f7-46cf-4348-8d28-cabdc7fa09ad req-17a6bb97-8d7d-483b-a9e8-efbf0e64feeb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:16.969500 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-1fde08f7-46cf-4348-8d28-cabdc7fa09ad req-17a6bb97-8d7d-483b-a9e8-efbf0e64feeb service nova] Creating event network-vif-plugged:80af1f02-8a99-4862-9946-cf9408dea4db for instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 on hv-cinder-83538 Jun 24 15:32:16.975359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-1fde08f7-46cf-4348-8d28-cabdc7fa09ad req-17a6bb97-8d7d-483b-a9e8-efbf0e64feeb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030125 Jun 24 15:32:16.975960 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 527/1040] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:32:17.601131 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:17.601657 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:17.603514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=10 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:17.608683 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:17.609181 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:17.609889 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:17.610326 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:17.739114 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:17.747080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fb8a6482-c1ac-4054-8c11-0539c8f0fee5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1367 microversion: 2.1 time: 0.149878 Jun 24 15:32:17.747662 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 514/1041] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:17 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:18.765032 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:18.765728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:18.772951 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:18.773658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:18.774430 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:18.774870 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:18.907477 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:18.915073 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-482e6186-a3ad-49d1-bad7-368b5ba03514 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1367 microversion: 2.1 time: 0.155093 Jun 24 15:32:18.915662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 528/1042] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:18 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:19.932845 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:19.933460 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:19.939961 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:19.940414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:19.941179 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:19.941617 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:20.073189 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:20.080623 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0628ab26-f154-4f8e-987d-ebc309b2706d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1557 microversion: 2.1 time: 0.152623 Jun 24 15:32:20.081191 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 515/1043] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:19 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:20.097681 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-83c46c76-366a-4fad-9e3b-2eeb20b3362a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:20.098174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-83c46c76-366a-4fad-9e3b-2eeb20b3362a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:20.104546 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83c46c76-366a-4fad-9e3b-2eeb20b3362a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:20.104990 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83c46c76-366a-4fad-9e3b-2eeb20b3362a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:20.105781 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83c46c76-366a-4fad-9e3b-2eeb20b3362a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:20.106223 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-83c46c76-366a-4fad-9e3b-2eeb20b3362a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:20.181855 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-83c46c76-366a-4fad-9e3b-2eeb20b3362a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087967 Jun 24 15:32:20.182451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 529/1044] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:32:20 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:32:21.397127 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-1f3b31ae-685d-403b-9daf-174d0a40dfa5 req-26a89a60-131e-48e1-9fc7-437d7065089e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5126022-24c8-422f-8b3c-4ece0ccd41f7", "tag": "80af1f02-8a99-4862-9946-cf9408dea4db"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:32:21.406817 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-1f3b31ae-685d-403b-9daf-174d0a40dfa5 req-26a89a60-131e-48e1-9fc7-437d7065089e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:21.407286 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-1f3b31ae-685d-403b-9daf-174d0a40dfa5 req-26a89a60-131e-48e1-9fc7-437d7065089e service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:21.418832 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-1f3b31ae-685d-403b-9daf-174d0a40dfa5 req-26a89a60-131e-48e1-9fc7-437d7065089e service nova] Creating event network-changed:80af1f02-8a99-4862-9946-cf9408dea4db for instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 on hv-cinder-83538 Jun 24 15:32:21.424312 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-1f3b31ae-685d-403b-9daf-174d0a40dfa5 req-26a89a60-131e-48e1-9fc7-437d7065089e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030794 Jun 24 15:32:21.425149 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 516/1045] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:32:55.200027 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:55.200787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=42 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:55.204581 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-006b59e1-5919-4f45-ae8b-43e58ca71bc5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:55.205075 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-006b59e1-5919-4f45-ae8b-43e58ca71bc5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:55.211085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-006b59e1-5919-4f45-ae8b-43e58ca71bc5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.212525 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-006b59e1-5919-4f45-ae8b-43e58ca71bc5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.213025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-006b59e1-5919-4f45-ae8b-43e58ca71bc5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.213464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-006b59e1-5919-4f45-ae8b-43e58ca71bc5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.236121 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-006b59e1-5919-4f45-ae8b-43e58ca71bc5 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7/ips" status: 200 len: 150 microversion: 2.1 time: 0.037637 Jun 24 15:32:55.236689 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 530/1046] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:32:55 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:32:55.245671 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:55.246403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=40 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:32:55.250632 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e8ac361-3609-4307-a465-6a65f5fdabfe"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:32:55.251835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:55.257748 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.258212 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.259583 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.260018 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.339134 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Invalid volume: volume 6e8ac361-3609-4307-a465-6a65f5fdabfe is already attached to instances: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7/os-volume_attachments HTTP/1.1 Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 74 Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:32:55.340892 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {"volumeAttachment": {"volumeId": "6e8ac361-3609-4307-a465-6a65f5fdabfe"}} Jun 24 15:32:55.342550 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Invalid volume: volume 6e8ac361-3609-4307-a465-6a65f5fdabfe is already attached to instances: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'server_id': 'c5126022-24c8-422f-8b3c-4ece0ccd41f7', 'body': {'volumeAttachment': {'volumeId': '6e8ac361-3609-4307-a465-6a65f5fdabfe'}}} Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6e8ac361-3609-4307-a465-6a65f5fdabfe is already attached to instances: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:55.343650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6e8ac361-3609-4307-a465-6a65f5fdabfe is already attached to instances: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:32:55.345258 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6e8ac361-3609-4307-a465-6a65f5fdabfe is already attached to instances: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 400 to user: Invalid volume: volume 6e8ac361-3609-4307-a465-6a65f5fdabfe is already attached to instances: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-da01dfb1-593d-4cc9-886d-a2020f0172d2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098982 Jun 24 15:32:55.347006 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 517/1047] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:32:55 2022] POST /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:32:55.351445 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:55.351944 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:55.358642 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.359095 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.359890 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.360327 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.384604 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:32:55.640797 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-343d8406-49a8-48c7-9d15-c71a1077964f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 204 len: 0 microversion: 2.1 time: 0.293475 Jun 24 15:32:55.641424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 531/1048] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:32:55 2022] DELETE /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:32:55.650432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:55.651040 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:55.657596 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.658046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.658811 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:55.659277 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:55.790909 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:55.798390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9b8e45a2-d7c0-4ea4-b44b-04428609c59f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1682 microversion: 2.1 time: 0.152464 Jun 24 15:32:55.799252 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 518/1049] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:55 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:56.817250 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:56.817950 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:56.825076 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:56.825524 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:56.826289 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:56.826725 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:56.963435 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:56.970763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5c2b1604-626f-4ef3-ac3f-a84ee9d5212c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1682 microversion: 2.1 time: 0.157763 Jun 24 15:32:56.971359 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 532/1050] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:56 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:57.825367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-2a8dc666-3af0-4b8e-b76d-f8a34ce5434d req-69d1a235-f14b-4dd8-995d-7e0389f17392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5126022-24c8-422f-8b3c-4ece0ccd41f7", "name": "network-vif-deleted", "tag": "80af1f02-8a99-4862-9946-cf9408dea4db"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:32:57.833183 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2a8dc666-3af0-4b8e-b76d-f8a34ce5434d req-69d1a235-f14b-4dd8-995d-7e0389f17392 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:57.836288 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-2a8dc666-3af0-4b8e-b76d-f8a34ce5434d req-69d1a235-f14b-4dd8-995d-7e0389f17392 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:57.845672 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-2a8dc666-3af0-4b8e-b76d-f8a34ce5434d req-69d1a235-f14b-4dd8-995d-7e0389f17392 service nova] Creating event network-vif-deleted:80af1f02-8a99-4862-9946-cf9408dea4db for instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 on hv-cinder-83538 Jun 24 15:32:57.850998 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-2a8dc666-3af0-4b8e-b76d-f8a34ce5434d req-69d1a235-f14b-4dd8-995d-7e0389f17392 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029951 Jun 24 15:32:57.851628 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 519/1051] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:32:57.988827 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:57.990170 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:57.997728 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:57.998280 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:57.999211 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:58.000278 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:58.075682 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:32:58.084497 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1d28585a-cc20-46fb-9979-959925235904 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 200 len: 1327 microversion: 2.1 time: 0.099202 Jun 24 15:32:58.084497 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 533/1052] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:57 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:32:59.103920 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:59.104781 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:32:59.111087 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:59.111575 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:59.112330 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:32:59.112762 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:32:59.126629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 HTTP/1.1 Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:32:59.128284 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:32:59.130012 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'c5126022-24c8-422f-8b3c-4ece0ccd41f7'} Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:32:59.130806 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:32:59.132133 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:32:59.133321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:32:59.133321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-709d44e2-59a3-4f89-8b73-3fb2adc8544e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 404 len: 111 microversion: 2.1 time: 0.031264 Jun 24 15:32:59.133321 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 520/1053] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:32:59 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:32:59.138595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-37155705-adf5-4ab4-933a-ad92d3b17054 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '.version_select at 0x7f18b2a1b040>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:32:59.195774 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-37155705-adf5-4ab4-933a-ad92d3b17054 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918359022" status: 202 len: 0 microversion: 2.1 time: 0.060957 Jun 24 15:32:59.196341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 534/1054] 10.222.0.67 () {58 vars in 1220 bytes} [Fri Jun 24 15:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918359022 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:33:00.006369 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:00.006855 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:00.013599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:00.014046 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:00.014810 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:00.015275 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:00.095364 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lazy-loading 'services' on Instance uuid 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:33:00.320088 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b1effa57-9c2f-4a62-825d-210059fe0dca tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments/6e8ac361-3609-4307-a465-6a65f5fdabfe" status: 202 len: 0 microversion: 2.1 time: 0.317423 Jun 24 15:33:00.320716 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 521/1055] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:33:00 2022] DELETE /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments/6e8ac361-3609-4307-a465-6a65f5fdabfe => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:33:00.330379 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-47685749-528f-408a-91ac-8858a9ea9a97 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:00.331360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-47685749-528f-408a-91ac-8858a9ea9a97 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:00.338092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47685749-528f-408a-91ac-8858a9ea9a97 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:00.338574 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47685749-528f-408a-91ac-8858a9ea9a97 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:00.339460 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47685749-528f-408a-91ac-8858a9ea9a97 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:00.339901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-47685749-528f-408a-91ac-8858a9ea9a97 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:00.369516 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-47685749-528f-408a-91ac-8858a9ea9a97 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042972 Jun 24 15:33:00.370006 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 535/1056] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:33:00 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:01.382375 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-df86a295-2365-47b6-9dba-7f2a13a13b74 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:01.383360 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-df86a295-2365-47b6-9dba-7f2a13a13b74 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:01.390331 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df86a295-2365-47b6-9dba-7f2a13a13b74 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:01.390786 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df86a295-2365-47b6-9dba-7f2a13a13b74 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:01.391586 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df86a295-2365-47b6-9dba-7f2a13a13b74 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:01.392029 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-df86a295-2365-47b6-9dba-7f2a13a13b74 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:01.420909 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-df86a295-2365-47b6-9dba-7f2a13a13b74 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043497 Jun 24 15:33:01.421472 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 522/1057] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:33:01 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:33:01.482545 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:01.483064 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:01.489145 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:01.489593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:01.490353 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:01.490787 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:01.517909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Going to try to terminate instance {{(pid=118274) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:33:01.749443 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-dbef8d8f-fbda-4172-9434-33d9c3fb177d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 204 len: 0 microversion: 2.1 time: 0.270500 Jun 24 15:33:01.750025 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 536/1058] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:33:01 2022] DELETE /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:33:01.758045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:01.760288 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:01.766445 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:01.766894 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:01.767757 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:01.768203 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:01.900353 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:01.907787 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e8d8a6db-ad0d-4771-ad8d-c3e04f3e2177 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1680 microversion: 2.1 time: 0.153590 Jun 24 15:33:01.908351 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 523/1059] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:01 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:02.926003 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:02.926709 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:02.933707 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:02.934159 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:02.934927 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:02.935398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:03.064259 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:03.072453 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1efed57b-173d-477b-86a0-35c36f16a7c4 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1680 microversion: 2.1 time: 0.150054 Jun 24 15:33:03.073374 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 537/1060] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:02 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:04.097843 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:04.100225 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-5cd70f90-f380-4796-a179-c693a36f30de req-67bdd92d-1a31-45fc-a7c8-0d46964371cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d205fe2-41b4-42a3-aca8-423d2d6ffd2d", "name": "network-vif-deleted", "tag": "649a0ab1-456d-4d91-b885-d5f4eb5249e8"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:33:04.107531 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:04.111731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5cd70f90-f380-4796-a179-c693a36f30de req-67bdd92d-1a31-45fc-a7c8-0d46964371cc service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:04.112279 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-5cd70f90-f380-4796-a179-c693a36f30de req-67bdd92d-1a31-45fc-a7c8-0d46964371cc service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:04.114128 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:04.114583 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:04.115393 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:04.115831 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:04.125689 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-5cd70f90-f380-4796-a179-c693a36f30de req-67bdd92d-1a31-45fc-a7c8-0d46964371cc service nova] Creating event network-vif-deleted:649a0ab1-456d-4d91-b885-d5f4eb5249e8 for instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d on hv-cinder-83538 Jun 24 15:33:04.131441 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-5cd70f90-f380-4796-a179-c693a36f30de req-67bdd92d-1a31-45fc-a7c8-0d46964371cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042385 Jun 24 15:33:04.132308 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 538/1061] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:04.190430 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:04.203497 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b194a83d-e460-4c42-9635-8c2d19fe5e27 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 200 len: 1612 microversion: 2.1 time: 0.117126 Jun 24 15:33:04.214144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 524/1062] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:04 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 1612 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:05.221955 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:05.222645 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:05.230316 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:05.230759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:05.231677 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:05.232113 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:05.245438 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d HTTP/1.1 Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:33:05.247008 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:33:05.248424 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '7d205fe2-41b4-42a3-aca8-423d2d6ffd2d'} Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:33:05.249383 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:33:05.251028 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:33:05.252636 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:33:05.252636 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-065050e9-26b6-4703-a07d-b657ba1cc644 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 404 len: 111 microversion: 2.1 time: 0.030806 Jun 24 15:33:05.252636 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 539/1063] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:05 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:33:05.257104 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-80531263-7901-4829-ba03-88bffe2d8f68 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '.version_select at 0x7f18b207d160>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:05.326795 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-80531263-7901-4829-ba03-88bffe2d8f68 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-825990121" status: 202 len: 0 microversion: 2.1 time: 0.073394 Jun 24 15:33:05.327389 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 525/1064] 10.222.0.67 () {58 vars in 1217 bytes} [Fri Jun 24 15:33:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-825990121 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 15:33:06.084425 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6c2c991c-0620-4a25-bf04-87f32d09d4a0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: .version_select at 0x7f18b2963ca0>, body: {"keypair": {"name": "tempest-keypair-517157698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdILtgjl9srVzfG/6Udxy/LU0pC0YMrM8Oiw+ndWRCGeHrJEg6AnJmJqbQnhWw/22MUIEaMhbOAD1KkBsTMVBfDQOdC2TlXEKTUpFor1wmWuMhEbHjx3E0R/MoekDYU9g=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:33:06.098620 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-6c2c991c-0620-4a25-bf04-87f32d09d4a0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:33:06.102404 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-6c2c991c-0620-4a25-bf04-87f32d09d4a0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:33:06.207861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6c2c991c-0620-4a25-bf04-87f32d09d4a0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127236 Jun 24 15:33:06.208452 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 540/1065] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:33:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:08.194582 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1857739465", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acd35ae0-cdce-4e2a-af0f-4813fbf5ee68"}], "security_groups": [{"name": "tempest-securitygroup--738398777"}], "key_name": "tempest-keypair-517157698", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:33:08.298394 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] validate_networks() for [('acd35ae0-cdce-4e2a-af0f-4813fbf5ee68', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:33:08.659586 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:33:08.660388 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:33:08.660880 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:33:08.661295 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:33:08.661711 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:33:08.671108 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:08.671592 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:08.672403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:08.672848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:08.689614 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:33:08.693523 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:33:08.705103 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:33:08.707399 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:33:08.848183 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-26f69c41-3057-4ff0-becd-bc8029400ab0 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.658298 Jun 24 15:33:08.850871 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 526/1066] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:33:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:33:08.859682 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-9effcf43-d4d9-4f7a-aef1-1bf4eed399be tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:08.860276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-9effcf43-d4d9-4f7a-aef1-1bf4eed399be tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:09.180593 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-9effcf43-d4d9-4f7a-aef1-1bf4eed399be tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:09.189729 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-9effcf43-d4d9-4f7a-aef1-1bf4eed399be tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1241 microversion: 2.1 time: 0.334907 Jun 24 15:33:09.190281 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 541/1067] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:08 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1241 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:10.207712 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:10.208299 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:10.215356 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:10.216650 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:10.217432 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:10.217878 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:10.284591 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:10.292414 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-0fcbe759-439e-452e-8709-f296fc1aa554 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1293 microversion: 2.1 time: 0.089025 Jun 24 15:33:10.292990 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 527/1068] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:10 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:11.310984 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:11.311622 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:11.318494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:11.318946 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:11.319759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:11.320197 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:11.533289 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:11.540808 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-18d62669-66bb-4776-ac81-d3396b715570 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.234781 Jun 24 15:33:11.541494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 542/1069] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:11 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:12.202496 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-62b62130-721d-47f1-9162-eafa475577d9 req-148cdfbf-4e8a-4910-84c4-7b3b01a7dd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ddde5c-6497-49ed-baf8-838d9790fc45", "tag": "5283617d-bc50-478c-aa58-c38346a18501"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:33:12.221646 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-62b62130-721d-47f1-9162-eafa475577d9 req-148cdfbf-4e8a-4910-84c4-7b3b01a7dd02 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:12.228340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-62b62130-721d-47f1-9162-eafa475577d9 req-148cdfbf-4e8a-4910-84c4-7b3b01a7dd02 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:12.241219 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-62b62130-721d-47f1-9162-eafa475577d9 req-148cdfbf-4e8a-4910-84c4-7b3b01a7dd02 service nova] Creating event network-changed:5283617d-bc50-478c-aa58-c38346a18501 for instance d4ddde5c-6497-49ed-baf8-838d9790fc45 on hv-cinder-83538 Jun 24 15:33:12.246336 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-62b62130-721d-47f1-9162-eafa475577d9 req-148cdfbf-4e8a-4910-84c4-7b3b01a7dd02 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047685 Jun 24 15:33:12.247510 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 528/1070] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:12.557949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:12.558604 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:12.566333 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:12.566789 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:12.567605 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:12.568052 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:12.789757 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:12.797746 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b1b0aa0f-5c51-4c1d-b3a0-5016fd0f210d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.243718 Jun 24 15:33:12.798331 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 543/1071] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:12 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:13.815533 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:13.816223 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:13.822309 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:13.822753 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:13.823533 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:13.823965 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:13.950835 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:13.958295 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-ad6b1c7a-4216-41aa-bbe1-8dae3942c993 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.147409 Jun 24 15:33:13.958839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 529/1072] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:13 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:14.974958 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:14.975597 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:14.982315 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:14.982769 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:14.983579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:14.984023 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:15.119909 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:15.128617 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-e92a9900-bdf9-4c85-9434-adb0336e4855 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.157473 Jun 24 15:33:15.129196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 544/1073] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:14 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:16.145864 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:16.146477 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:16.153838 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:16.154289 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:16.155055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:16.155525 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:16.284265 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:16.291629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-fffb4709-fa7d-496a-ac21-136a0d16252b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.149588 Jun 24 15:33:16.292192 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 530/1074] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:16 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:17.308653 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:17.309429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:17.315983 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:17.316427 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:17.317183 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:17.317612 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:17.446358 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:17.454386 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7d98072f-b6fc-4241-a130-6cb32f47dbee tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.149703 Jun 24 15:33:17.454941 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 545/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:17 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:18.471658 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:18.472270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:18.478631 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:18.479086 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:18.479890 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:18.480334 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:18.611489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:18.619138 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-547cdbcc-bb0f-43a9-8026-ccb73997da38 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.151336 Jun 24 15:33:18.619725 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 531/1076] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:18 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:19.096230 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-f08a93be-b926-426b-b707-ef6b24cca08d req-a1d0342a-68b4-4eb0-9082-a9fb9d473dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ddde5c-6497-49ed-baf8-838d9790fc45", "name": "network-vif-plugged", "status": "completed", "tag": "5283617d-bc50-478c-aa58-c38346a18501"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:33:19.104953 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f08a93be-b926-426b-b707-ef6b24cca08d req-a1d0342a-68b4-4eb0-9082-a9fb9d473dbf service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:19.105405 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-f08a93be-b926-426b-b707-ef6b24cca08d req-a1d0342a-68b4-4eb0-9082-a9fb9d473dbf service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:19.117589 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-f08a93be-b926-426b-b707-ef6b24cca08d req-a1d0342a-68b4-4eb0-9082-a9fb9d473dbf service nova] Creating event network-vif-plugged:5283617d-bc50-478c-aa58-c38346a18501 for instance d4ddde5c-6497-49ed-baf8-838d9790fc45 on hv-cinder-83538 Jun 24 15:33:19.123824 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-f08a93be-b926-426b-b707-ef6b24cca08d req-a1d0342a-68b4-4eb0-9082-a9fb9d473dbf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Jun 24 15:33:19.124410 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 546/1077] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:19.636338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:19.637003 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:19.638958 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:33:19.639679 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:33:19.644935 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:19.645592 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:19.646185 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:19.646624 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:19.773241 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:19.781499 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b0e36e6a-6a14-4197-a2c4-2a35373a815e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1366 microversion: 2.1 time: 0.149019 Jun 24 15:33:19.782058 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 532/1078] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:19 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:20.799125 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:20.799777 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:20.801744 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:33:20.807271 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:20.807724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:20.808490 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:20.809596 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:20.941662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:33:20.949096 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fccb25a2-9cd4-433c-b3eb-3ad2b4df0094 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1555 microversion: 2.1 time: 0.154270 Jun 24 15:33:20.949692 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 547/1079] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:33:20 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:33:20.965713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-97d25db1-515f-43d3-b83b-4f51b593d44c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:20.966310 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-97d25db1-515f-43d3-b83b-4f51b593d44c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:20.972857 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97d25db1-515f-43d3-b83b-4f51b593d44c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:20.973302 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97d25db1-515f-43d3-b83b-4f51b593d44c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:20.974115 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97d25db1-515f-43d3-b83b-4f51b593d44c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:20.974547 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-97d25db1-515f-43d3-b83b-4f51b593d44c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:21.050097 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-97d25db1-515f-43d3-b83b-4f51b593d44c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088567 Jun 24 15:33:21.050685 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 533/1080] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:33:20 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:22.036009 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-16904fdb-5d51-4a32-896b-16d07c97f84f req-1d5a95e1-c5c7-4021-9d36-eb1d7c951d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ddde5c-6497-49ed-baf8-838d9790fc45", "tag": "5283617d-bc50-478c-aa58-c38346a18501"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:33:22.045017 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-16904fdb-5d51-4a32-896b-16d07c97f84f req-1d5a95e1-c5c7-4021-9d36-eb1d7c951d91 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:22.045459 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-16904fdb-5d51-4a32-896b-16d07c97f84f req-1d5a95e1-c5c7-4021-9d36-eb1d7c951d91 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:22.056135 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-16904fdb-5d51-4a32-896b-16d07c97f84f req-1d5a95e1-c5c7-4021-9d36-eb1d7c951d91 service nova] Creating event network-changed:5283617d-bc50-478c-aa58-c38346a18501 for instance d4ddde5c-6497-49ed-baf8-838d9790fc45 on hv-cinder-83538 Jun 24 15:33:22.061814 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-16904fdb-5d51-4a32-896b-16d07c97f84f req-1d5a95e1-c5c7-4021-9d36-eb1d7c951d91 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029539 Jun 24 15:33:22.062564 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 548/1081] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:57.934887 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:33:57.935704 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:33:57.940169 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-87f722ca-2ffd-44ca-b215-8996a4c89b25 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:33:57.940693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-87f722ca-2ffd-44ca-b215-8996a4c89b25 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:57.946561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87f722ca-2ffd-44ca-b215-8996a4c89b25 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:57.950307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87f722ca-2ffd-44ca-b215-8996a4c89b25 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:57.950307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87f722ca-2ffd-44ca-b215-8996a4c89b25 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:57.950307 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-87f722ca-2ffd-44ca-b215-8996a4c89b25 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:57.973409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-87f722ca-2ffd-44ca-b215-8996a4c89b25 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/ips" status: 200 len: 149 microversion: 2.1 time: 0.040030 Jun 24 15:33:57.973991 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 534/1082] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:33:57 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:33:59.480186 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:33:59.480967 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:33:59.485326 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b11b8e04-0b90-4503-a920-802774d66711 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7182eb6-9288-414f-8ee4-ac1f88fb25e6"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:33:59.486558 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b11b8e04-0b90-4503-a920-802774d66711 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:33:59.492735 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b11b8e04-0b90-4503-a920-802774d66711 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:59.493189 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b11b8e04-0b90-4503-a920-802774d66711 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:33:59.493965 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b11b8e04-0b90-4503-a920-802774d66711 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:33:59.494402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b11b8e04-0b90-4503-a920-802774d66711 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:00.477834 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b11b8e04-0b90-4503-a920-802774d66711 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.999019 Jun 24 15:34:00.478508 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 549/1083] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:33:59 2022] POST /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments => generated 194 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:34:07.964109 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7182eb6-9288-414f-8ee4-ac1f88fb25e6"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:34:07.965235 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:07.971710 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:07.974839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:07.974839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:07.974839 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:08.106850 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Invalid volume: volume f7182eb6-9288-414f-8ee4-ac1f88fb25e6 is already attached to instances: d4ddde5c-6497-49ed-baf8-838d9790fc45 Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: POST /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments HTTP/1.1 Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 74 Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:34:08.109159 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {"volumeAttachment": {"volumeId": "f7182eb6-9288-414f-8ee4-ac1f88fb25e6"}} Jun 24 15:34:08.110634 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Invalid volume: volume f7182eb6-9288-414f-8ee4-ac1f88fb25e6 is already attached to instances: d4ddde5c-6497-49ed-baf8-838d9790fc45 Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'server_id': 'd4ddde5c-6497-49ed-baf8-838d9790fc45', 'body': {'volumeAttachment': {'volumeId': 'f7182eb6-9288-414f-8ee4-ac1f88fb25e6'}}} Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f7182eb6-9288-414f-8ee4-ac1f88fb25e6 is already attached to instances: d4ddde5c-6497-49ed-baf8-838d9790fc45 Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:34:08.111540 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f7182eb6-9288-414f-8ee4-ac1f88fb25e6 is already attached to instances: d4ddde5c-6497-49ed-baf8-838d9790fc45 Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:34:08.113055 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f7182eb6-9288-414f-8ee4-ac1f88fb25e6 is already attached to instances: d4ddde5c-6497-49ed-baf8-838d9790fc45 Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 400 to user: Invalid volume: volume f7182eb6-9288-414f-8ee4-ac1f88fb25e6 is already attached to instances: d4ddde5c-6497-49ed-baf8-838d9790fc45 {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1a3074dc-5360-4a47-919c-6b39a6206bcd tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151417 Jun 24 15:34:08.114750 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 535/1084] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:34:07 2022] POST /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 15:34:08.172267 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:08.172857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:08.179062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:08.179546 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:08.180321 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:08.180767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:08.258763 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lazy-loading 'services' on Instance uuid d4ddde5c-6497-49ed-baf8-838d9790fc45 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:34:08.501807 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aaed7e8e-7b2f-4208-8666-693aac25ef92 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments/f7182eb6-9288-414f-8ee4-ac1f88fb25e6" status: 202 len: 0 microversion: 2.1 time: 0.334812 Jun 24 15:34:08.502427 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 550/1085] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:34:08 2022] DELETE /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments/f7182eb6-9288-414f-8ee4-ac1f88fb25e6 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:34:08.510724 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-557d55e8-b429-4f1c-882d-eb6a26f48039 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:08.511693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-557d55e8-b429-4f1c-882d-eb6a26f48039 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:08.518217 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-557d55e8-b429-4f1c-882d-eb6a26f48039 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:08.518652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-557d55e8-b429-4f1c-882d-eb6a26f48039 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:08.519445 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-557d55e8-b429-4f1c-882d-eb6a26f48039 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:08.519875 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-557d55e8-b429-4f1c-882d-eb6a26f48039 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:08.549489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-557d55e8-b429-4f1c-882d-eb6a26f48039 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Jun 24 15:34:08.550025 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 536/1086] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:34:08 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:34:09.562269 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-fba9ccac-417a-4715-9aea-4332c99602e1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:09.563345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-fba9ccac-417a-4715-9aea-4332c99602e1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:09.569520 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fba9ccac-417a-4715-9aea-4332c99602e1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:09.569968 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fba9ccac-417a-4715-9aea-4332c99602e1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:09.570731 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fba9ccac-417a-4715-9aea-4332c99602e1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:09.571163 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-fba9ccac-417a-4715-9aea-4332c99602e1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:09.601127 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-fba9ccac-417a-4715-9aea-4332c99602e1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043713 Jun 24 15:34:09.601670 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 551/1087] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:34:09 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:34:09.657899 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:09.658430 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:09.664734 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:09.665181 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:09.665937 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:09.666373 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:09.691081 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:34:09.970670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9cfe7c3a-831f-4059-8a48-13c016ddfa0d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 204 len: 0 microversion: 2.1 time: 0.316848 Jun 24 15:34:09.971281 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 537/1088] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:34:09 2022] DELETE /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:34:09.979398 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:09.981499 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:09.986225 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:09.986667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:09.987502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:09.987941 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:10.116402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:10.123927 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c7d1f8ad-66ed-4e89-aa03-886bc9765fa2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1680 microversion: 2.1 time: 0.148474 Jun 24 15:34:10.124485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 552/1089] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:09 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:11.141934 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:11.142659 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:11.151824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:11.152266 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:11.153031 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:11.153457 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:11.304524 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:11.313298 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-35e9032a-589e-4c51-a2d4-95c0c4ec0bd6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1680 microversion: 2.1 time: 0.175836 Jun 24 15:34:11.314109 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 538/1090] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:11 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:12.329961 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-cacac67e-295b-4fb1-8eb7-7c513a20d181 req-674fea2d-2f6d-4e3e-a0dd-ab8fd72d18eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ddde5c-6497-49ed-baf8-838d9790fc45", "name": "network-vif-deleted", "tag": "5283617d-bc50-478c-aa58-c38346a18501"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:34:12.338761 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:12.340917 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:12.341062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-cacac67e-295b-4fb1-8eb7-7c513a20d181 req-674fea2d-2f6d-4e3e-a0dd-ab8fd72d18eb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:12.341062 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-cacac67e-295b-4fb1-8eb7-7c513a20d181 req-674fea2d-2f6d-4e3e-a0dd-ab8fd72d18eb service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:12.345905 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:12.346625 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:12.347619 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:12.348061 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:12.353675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-cacac67e-295b-4fb1-8eb7-7c513a20d181 req-674fea2d-2f6d-4e3e-a0dd-ab8fd72d18eb service nova] Creating event network-vif-deleted:5283617d-bc50-478c-aa58-c38346a18501 for instance d4ddde5c-6497-49ed-baf8-838d9790fc45 on hv-cinder-83538 Jun 24 15:34:12.359451 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-cacac67e-295b-4fb1-8eb7-7c513a20d181 req-674fea2d-2f6d-4e3e-a0dd-ab8fd72d18eb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033983 Jun 24 15:34:12.360131 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 553/1091] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:34:12.437647 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:12.447221 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-4540b0cc-ae2c-46b0-ad5d-7b178e0bef93 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 200 len: 1613 microversion: 2.1 time: 0.112124 Jun 24 15:34:12.452416 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 539/1092] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:12 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:34:13.465160 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:13.465780 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:13.472541 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:13.472994 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:13.473759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:13.474201 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:13.487369 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 HTTP/1.1 Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:34:13.488954 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:34:13.490575 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'd4ddde5c-6497-49ed-baf8-838d9790fc45'} Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:34:13.491702 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:34:13.493252 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:34:13.494796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:34:13.494796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-a8edb38c-5070-4c9a-a0cc-32bbeaa8f5cc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 404 len: 111 microversion: 2.1 time: 0.029553 Jun 24 15:34:13.494796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 554/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:13 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:34:13.499590 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-2dd7afcc-1dfa-4ffe-9f95-193f9752ef83 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '.version_select at 0x7f18b206d1f0>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:13.605954 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-2dd7afcc-1dfa-4ffe-9f95-193f9752ef83 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517157698" status: 202 len: 0 microversion: 2.1 time: 0.110652 Jun 24 15:34:13.606514 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 540/1094] 10.222.0.67 () {58 vars in 1217 bytes} [Fri Jun 24 15:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517157698 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 15:34:14.318729 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5121496c-c53f-4f1e-bf07-23a9aabdabda tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: .version_select at 0x7f18b2a7a700>, body: {"keypair": {"name": "tempest-keypair-1066847839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzpU2bw1HjRfvn5CsfywtKymqOvUrXCMVg9/nSixKf75Qc9Kzan+cSDXR4+IH7vo64z6PaBcoA7l8Hl6pVbkpEgdxL4hkQLH+Pb046JWX+S9uqwQvBzDBmt4TR7j2g11w=="}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:34:14.332675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-5121496c-c53f-4f1e-bf07-23a9aabdabda tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:34:14.336455 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-5121496c-c53f-4f1e-bf07-23a9aabdabda tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'key_pairs'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:34:14.417400 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5121496c-c53f-4f1e-bf07-23a9aabdabda tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102451 Jun 24 15:34:14.417997 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 555/1095] 10.222.0.67 () {60 vars in 1158 bytes} [Fri Jun 24 15:34:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:34:16.375516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2145597443", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acd35ae0-cdce-4e2a-af0f-4813fbf5ee68"}], "security_groups": [{"name": "tempest-securitygroup--414872906"}], "key_name": "tempest-keypair-1066847839", "user_data": "}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:34:16.479269 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.network.neutron [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] validate_networks() for [('acd35ae0-cdce-4e2a-af0f-4813fbf5ee68', None, None, None, None, None)] {{(pid=118273) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:34:16.845774 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:34:16.846222 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image limits 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:34:16.846692 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Flavor pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:34:16.847243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Image pref 0:0:0 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:34:16.847651 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.virt.hardware [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:34:16.856368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:16.856812 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:16.858087 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:16.858521 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:16.875391 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:34:16.879272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.quota [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Getting quotas for user 920e7c03e9b94550880b452d84f07128 and project 9c0e7447465d430d9352d9e9b7ea012c. Resources: {'ram', 'instances', 'cores'} {{(pid=118273) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:34:16.890375 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Going to run 1 instances... {{(pid=118273) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:34:16.892649 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:34:17.001693 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6c2f062a-6f68-4c08-aca7-a885e98d4f1a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.631122 Jun 24 15:34:17.002259 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 541/1096] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:34:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:34:17.012753 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bf90d848-abf2-49e8-bb11-c53cf7066e2a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:17.013365 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bf90d848-abf2-49e8-bb11-c53cf7066e2a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:17.071678 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-bf90d848-abf2-49e8-bb11-c53cf7066e2a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:17.078877 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bf90d848-abf2-49e8-bb11-c53cf7066e2a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1242 microversion: 2.1 time: 0.070606 Jun 24 15:34:17.079502 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 556/1097] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:17 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:18.096352 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:18.096911 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:18.104144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:18.104604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:18.105436 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:18.105876 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:18.169045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:18.177050 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-1d3f1eba-ad91-483c-b701-2f1c4131e91a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1246 microversion: 2.1 time: 0.085682 Jun 24 15:34:18.177598 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 542/1098] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:18 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:19.193583 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:19.194196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:19.200718 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:19.201171 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:19.201985 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:19.202609 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:19.284526 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:19.291863 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5fd5b457-07f1-44ee-b0e7-4454e3dade7f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1300 microversion: 2.1 time: 0.102114 Jun 24 15:34:19.292420 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 557/1099] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:19 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:20.309376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:20.310171 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:20.321778 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:20.322229 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:20.323002 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:20.323468 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:20.518403 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:20.526253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f9cf0a54-0bd2-4ddc-84ef-d58a61d781cf tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.220682 Jun 24 15:34:20.526907 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 543/1100] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:20 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:20.675799 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-a6808e66-487d-44c0-8ae3-d396584e769e req-4d0e5dd6-871d-4296-92ab-35e5a784aad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff605ac2-bccd-4e0c-a8ef-95d5537b6b46", "tag": "f9cd0892-ff63-4862-83d9-c71d751bba17"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:34:20.685845 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a6808e66-487d-44c0-8ae3-d396584e769e req-4d0e5dd6-871d-4296-92ab-35e5a784aad4 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:20.686512 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-a6808e66-487d-44c0-8ae3-d396584e769e req-4d0e5dd6-871d-4296-92ab-35e5a784aad4 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:20.698579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-a6808e66-487d-44c0-8ae3-d396584e769e req-4d0e5dd6-871d-4296-92ab-35e5a784aad4 service nova] Creating event network-changed:f9cd0892-ff63-4862-83d9-c71d751bba17 for instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 on hv-cinder-83538 Jun 24 15:34:20.703705 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-a6808e66-487d-44c0-8ae3-d396584e769e req-4d0e5dd6-871d-4296-92ab-35e5a784aad4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032329 Jun 24 15:34:20.704370 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 558/1101] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:34:21.544506 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:21.545084 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:21.551969 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:21.552413 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:21.553953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:21.553953 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:21.684914 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:21.692821 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-d198eace-0a7d-48d0-b2db-0e2f38017863 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.152305 Jun 24 15:34:21.693376 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 544/1102] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:21 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:22.710686 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:22.711439 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:22.718158 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:22.718579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:22.719373 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:22.719803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:22.846043 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:22.853632 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2e5e9743-7274-46e8-926b-9211b3214f52 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.147661 Jun 24 15:34:22.854196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 559/1103] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:22 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:23.871045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:23.871681 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:23.878587 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:23.879031 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:23.879846 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:23.880279 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:24.010236 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:24.017669 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-10b86963-47b4-46db-8f02-86f568371789 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.150520 Jun 24 15:34:24.018225 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 545/1104] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:23 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:25.034611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:25.035243 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:25.041738 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:25.042202 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:25.042969 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:25.043446 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:25.172046 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:25.179559 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c90aa68e-3823-4b72-b2e8-e18cf95f73fc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.148828 Jun 24 15:34:25.180129 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 560/1105] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:25 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:26.196654 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:26.197241 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:26.204251 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:26.204694 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:26.205449 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:26.205903 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:26.334720 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:26.342135 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5db2a50d-b8ac-4874-80f6-1f36195539b1 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.149287 Jun 24 15:34:26.344170 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 546/1106] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:26 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:27.355658 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-55c4905a-10ab-4e64-b1a4-dc7041540958 req-50010237-5db4-4cf8-9e0c-e15920a14ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff605ac2-bccd-4e0c-a8ef-95d5537b6b46", "name": "network-vif-plugged", "status": "completed", "tag": "f9cd0892-ff63-4862-83d9-c71d751bba17"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:34:27.359367 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:27.360739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:27.360943 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:27.364283 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:27.368199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=6 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:27.368335 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-55c4905a-10ab-4e64-b1a4-dc7041540958 req-50010237-5db4-4cf8-9e0c-e15920a14ee6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:27.368335 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-55c4905a-10ab-4e64-b1a4-dc7041540958 req-50010237-5db4-4cf8-9e0c-e15920a14ee6 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:27.369676 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:27.370198 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:27.371039 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:27.371561 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:27.380636 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-55c4905a-10ab-4e64-b1a4-dc7041540958 req-50010237-5db4-4cf8-9e0c-e15920a14ee6 service nova] Creating event network-vif-plugged:f9cd0892-ff63-4862-83d9-c71d751bba17 for instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 on hv-cinder-83538 Jun 24 15:34:27.385500 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-55c4905a-10ab-4e64-b1a4-dc7041540958 req-50010237-5db4-4cf8-9e0c-e15920a14ee6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033649 Jun 24 15:34:27.386171 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 561/1107] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:34:27.505567 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:27.513737 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-da492c0a-dcea-4316-a96c-f360bf33c3ea tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.158538 Jun 24 15:34:27.514310 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 547/1108] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:27 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:34:28.533170 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:28.533856 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:28.540752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:28.541196 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:28.541949 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:28.542382 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:28.673063 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:28.680389 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-ba868385-ec34-4487-8163-a8304d5c669d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1367 microversion: 2.1 time: 0.152219 Jun 24 15:34:28.680978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 562/1109] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:28 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:29.697498 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:29.698092 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:29.705469 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:29.705915 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:29.706759 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:29.707209 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:29.837346 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:34:29.844765 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-5b8f1a4a-b788-4ca8-ad21-c74a36f58c1f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1557 microversion: 2.1 time: 0.151126 Jun 24 15:34:29.847652 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 548/1110] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:34:29 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:34:29.861344 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-67d41a7d-85f3-40e8-9ddb-c35bceb08e2b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:34:29.861881 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-67d41a7d-85f3-40e8-9ddb-c35bceb08e2b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:34:29.864926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:29.869860 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67d41a7d-85f3-40e8-9ddb-c35bceb08e2b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:29.870313 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67d41a7d-85f3-40e8-9ddb-c35bceb08e2b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:29.871085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67d41a7d-85f3-40e8-9ddb-c35bceb08e2b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:29.871656 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-67d41a7d-85f3-40e8-9ddb-c35bceb08e2b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:29.874022 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:29.948391 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-67d41a7d-85f3-40e8-9ddb-c35bceb08e2b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090871 Jun 24 15:34:29.948991 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 563/1111] 10.222.0.67 () {58 vars in 1274 bytes} [Fri Jun 24 15:34:29 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:34:31.164896 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-df7b84d6-6435-401a-b8eb-9839a6975fd1 req-e4d95cb1-76df-47ba-8644-7da124f0029a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff605ac2-bccd-4e0c-a8ef-95d5537b6b46", "tag": "f9cd0892-ff63-4862-83d9-c71d751bba17"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:34:31.173052 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-df7b84d6-6435-401a-b8eb-9839a6975fd1 req-e4d95cb1-76df-47ba-8644-7da124f0029a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:34:31.173494 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-df7b84d6-6435-401a-b8eb-9839a6975fd1 req-e4d95cb1-76df-47ba-8644-7da124f0029a service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:34:31.184276 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-df7b84d6-6435-401a-b8eb-9839a6975fd1 req-e4d95cb1-76df-47ba-8644-7da124f0029a service nova] Creating event network-changed:f9cd0892-ff63-4862-83d9-c71d751bba17 for instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 on hv-cinder-83538 Jun 24 15:34:31.189425 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-df7b84d6-6435-401a-b8eb-9839a6975fd1 req-e4d95cb1-76df-47ba-8644-7da124f0029a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028154 Jun 24 15:34:31.190014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 549/1112] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:35:06.406042 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8c7e089b-6e12-477e-9e50-1dbe23f95778 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:06.406652 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8c7e089b-6e12-477e-9e50-1dbe23f95778 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:06.414641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c7e089b-6e12-477e-9e50-1dbe23f95778 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:06.415085 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c7e089b-6e12-477e-9e50-1dbe23f95778 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:06.415874 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c7e089b-6e12-477e-9e50-1dbe23f95778 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:06.416311 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8c7e089b-6e12-477e-9e50-1dbe23f95778 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:06.439582 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8c7e089b-6e12-477e-9e50-1dbe23f95778 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/ips" status: 200 len: 149 microversion: 2.1 time: 0.038541 Jun 24 15:35:06.440154 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 564/1113] 10.222.0.67 () {58 vars in 1247 bytes} [Fri Jun 24 15:35:06 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:35:08.056246 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:35:08.056992 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:35:08.061186 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-aec01a08-fec9-4d94-b9c2-c37991c716ba tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eb7a8e9-e176-4548-9cdb-e05e6e1baa8f"}} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:35:08.062313 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-aec01a08-fec9-4d94-b9c2-c37991c716ba tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:08.068206 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aec01a08-fec9-4d94-b9c2-c37991c716ba tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:08.075056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aec01a08-fec9-4d94-b9c2-c37991c716ba tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:08.075056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aec01a08-fec9-4d94-b9c2-c37991c716ba tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:08.075056 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-aec01a08-fec9-4d94-b9c2-c37991c716ba tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:08.774010 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-aec01a08-fec9-4d94-b9c2-c37991c716ba tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "POST /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719101 Jun 24 15:35:08.774629 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 550/1114] 10.222.0.67 () {60 vars in 1322 bytes} [Fri Jun 24 15:35:08 2022] POST /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:35:16.361895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:16.362417 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:16.369926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:16.370376 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:16.371151 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:16.371619 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:16.452857 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.objects.instance [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lazy-loading 'services' on Instance uuid ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 {{(pid=118274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:35:16.643978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7105af2d-4bdf-4e85-816a-cca70fe3023f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments/0eb7a8e9-e176-4548-9cdb-e05e6e1baa8f" status: 202 len: 0 microversion: 2.1 time: 0.286108 Jun 24 15:35:16.651811 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 565/1115] 10.222.0.67 () {58 vars in 1415 bytes} [Fri Jun 24 15:35:16 2022] DELETE /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments/0eb7a8e9-e176-4548-9cdb-e05e6e1baa8f => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:35:16.654824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e069e28c-9491-42c9-a733-19e55f90f66e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:16.655931 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e069e28c-9491-42c9-a733-19e55f90f66e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:16.662422 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e069e28c-9491-42c9-a733-19e55f90f66e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:16.662948 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e069e28c-9491-42c9-a733-19e55f90f66e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:16.664069 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e069e28c-9491-42c9-a733-19e55f90f66e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:16.664510 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e069e28c-9491-42c9-a733-19e55f90f66e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:16.693054 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e069e28c-9491-42c9-a733-19e55f90f66e tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Jun 24 15:35:16.693599 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 551/1116] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:35:16 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:35:17.706174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2f6a50f6-8f1a-4637-b3db-03513ac68a09 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:17.707165 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2f6a50f6-8f1a-4637-b3db-03513ac68a09 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:17.713926 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f6a50f6-8f1a-4637-b3db-03513ac68a09 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:17.714368 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f6a50f6-8f1a-4637-b3db-03513ac68a09 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:17.715121 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f6a50f6-8f1a-4637-b3db-03513ac68a09 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:17.715580 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2f6a50f6-8f1a-4637-b3db-03513ac68a09 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:17.743744 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2f6a50f6-8f1a-4637-b3db-03513ac68a09 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042280 Jun 24 15:35:17.744288 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 566/1117] 10.222.0.67 () {58 vars in 1301 bytes} [Fri Jun 24 15:35:17 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 15:35:17.799510 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:17.800045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:17.806375 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:17.806824 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:17.807604 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:17.808060 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:17.832096 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:35:18.084530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a868b0fb-e21c-4283-8733-d690cf245375 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 204 len: 0 microversion: 2.1 time: 0.288539 Jun 24 15:35:18.085808 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 552/1118] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:35:17 2022] DELETE /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 15:35:18.093880 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:18.094804 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:18.100836 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:18.101279 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:18.102055 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:18.102494 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:18.234819 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:35:18.243026 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1fbd7e56-5996-4daf-8b7d-9edd5965750c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1681 microversion: 2.1 time: 0.152977 Jun 24 15:35:18.243623 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 567/1119] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:18 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:35:19.261820 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:19.262517 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:19.269075 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:19.269530 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:19.270552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:19.270986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:19.401420 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:35:19.409020 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-11d3c2f3-7206-4af3-a40f-9d47e8c1eec6 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1681 microversion: 2.1 time: 0.152098 Jun 24 15:35:19.409577 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 553/1120] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:19 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:35:20.426205 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:20.426815 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:20.433978 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:20.435914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:20.435914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:20.435914 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:20.527287 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-0ac40654-e678-4553-8970-40f0477efe4d req-de8c8787-cbcb-40af-8192-11e67f4e5857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff605ac2-bccd-4e0c-a8ef-95d5537b6b46", "name": "network-vif-deleted", "tag": "f9cd0892-ff63-4862-83d9-c71d751bba17"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:35:20.528146 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920e7c03e9b94550880b452d84f07128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0e7447465d430d9352d9e9b7ea012c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:35:20.536164 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-8aa2a80b-ab62-44f6-8128-270afd6bd10a tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 200 len: 1614 microversion: 2.1 time: 0.113971 Jun 24 15:35:20.536754 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-0ac40654-e678-4553-8970-40f0477efe4d req-de8c8787-cbcb-40af-8192-11e67f4e5857 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:20.536895 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 568/1121] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:20 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:35:20.547119 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-0ac40654-e678-4553-8970-40f0477efe4d req-de8c8787-cbcb-40af-8192-11e67f4e5857 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:20.563730 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-0ac40654-e678-4553-8970-40f0477efe4d req-de8c8787-cbcb-40af-8192-11e67f4e5857 service nova] Creating event network-vif-deleted:f9cd0892-ff63-4862-83d9-c71d751bba17 for instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 on hv-cinder-83538 Jun 24 15:35:20.569454 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-0ac40654-e678-4553-8970-40f0477efe4d req-de8c8787-cbcb-40af-8192-11e67f4e5857 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045601 Jun 24 15:35:20.573826 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 554/1122] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 15:35:21.439457 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:35:21.440072 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:35:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:35:21.554024 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:21.556578 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:21.561680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:21.562133 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:21.562943 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:21.563408 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:21.577829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 HTTP/1.1 Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:35:21.579511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:21.587247 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'ff605ac2-bccd-4e0c-a8ef-95d5537b6b46'} Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:21.589007 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:21.590611 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:21.592082 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:21.592082 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-20d2fb11-83c1-4fc2-b391-b452c3f919bc tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 404 len: 111 microversion: 2.1 time: 0.030833 Jun 24 15:35:21.592082 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 569/1123] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:21 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:35:21.592361 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e0d6850e-f94a-4cf6-b729-a669d9647c77 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '.version_select at 0x7f18b1f0a820>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:21.673488 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e0d6850e-f94a-4cf6-b729-a669d9647c77 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066847839" status: 202 len: 0 microversion: 2.1 time: 0.086438 Jun 24 15:35:21.674080 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 555/1124] 10.222.0.67 () {58 vars in 1220 bytes} [Fri Jun 24 15:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066847839 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 15:35:23.691509 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:23.692058 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:23.699111 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:23.699595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:23.700356 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:23.700785 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:23.715675 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 HTTP/1.1 Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:35:23.717190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.718816 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'ff605ac2-bccd-4e0c-a8ef-95d5537b6b46'} Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:23.719743 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.721276 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.722876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:23.722876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-b5c5dff5-e0bb-4cd3-a36e-92b46a3c2c5f tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 404 len: 111 microversion: 2.1 time: 0.030830 Jun 24 15:35:23.722876 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 570/1125] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:35:23 2022] DELETE /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:35:23.727848 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:23.728581 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: ff605ac2-bccd-4e0c-a8ef-95d5537b6b46] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:23.735296 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:23.735749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:23.736504 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:23.736982 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:23.752368 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 HTTP/1.1 Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:35:23.757546 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.759304 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'ff605ac2-bccd-4e0c-a8ef-95d5537b6b46'} Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:23.760220 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. Jun 24 15:35:23.761489 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:23.763243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:23.763243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-bbb705bf-cdd2-4f79-bbdc-667293deeb6d tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46" status: 404 len: 111 microversion: 2.1 time: 0.032249 Jun 24 15:35:23.763243 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 556/1126] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:23 2022] GET /compute/v2.1/servers/ff605ac2-bccd-4e0c-a8ef-95d5537b6b46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:35:25.015717 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:25.016206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:25.023730 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.024174 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.024962 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.025389 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.038749 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 HTTP/1.1 Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:35:25.040299 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.041982 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'd4ddde5c-6497-49ed-baf8-838d9790fc45'} Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:25.042829 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.044571 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.046229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:25.046229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-bb51ed24-a985-49ed-93e3-9a00720f675c tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 404 len: 111 microversion: 2.1 time: 0.029799 Jun 24 15:35:25.046229 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 571/1127] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:35:25 2022] DELETE /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:35:25.049939 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:25.050544 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: d4ddde5c-6497-49ed-baf8-838d9790fc45] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:25.057102 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.057543 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.058292 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.058721 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.072673 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 HTTP/1.1 Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:35:25.074160 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.075813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'd4ddde5c-6497-49ed-baf8-838d9790fc45'} Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:25.076902 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. Jun 24 15:35:25.078470 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.081986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance d4ddde5c-6497-49ed-baf8-838d9790fc45 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:25.081986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-19bd26b7-8282-4da7-861b-e68eb8298c73 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45" status: 404 len: 111 microversion: 2.1 time: 0.029292 Jun 24 15:35:25.081986 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 557/1128] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:25 2022] GET /compute/v2.1/servers/d4ddde5c-6497-49ed-baf8-838d9790fc45 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 15:35:25.089203 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:25.089707 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:25.096503 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.096503 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.097366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.097819 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.111901 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 HTTP/1.1 Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:35:25.116627 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.118261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'c5126022-24c8-422f-8b3c-4ece0ccd41f7'} Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:25.119132 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.120534 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.121865 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:25.121865 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-cdc41a90-8395-4a48-a09a-080c7573670b tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 404 len: 111 microversion: 2.1 time: 0.030503 Jun 24 15:35:25.121865 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 572/1129] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:35:25 2022] DELETE /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:35:25.123989 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:25.124621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: c5126022-24c8-422f-8b3c-4ece0ccd41f7] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:25.130522 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.130964 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.132381 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:25.132813 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:25.145950 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 HTTP/1.1 Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:35:25.147516 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.149231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': 'c5126022-24c8-422f-8b3c-4ece0ccd41f7'} Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:25.150172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. Jun 24 15:35:25.156398 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:25.157763 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance c5126022-24c8-422f-8b3c-4ece0ccd41f7 could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:25.157763 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-e12745c5-059c-4db7-b749-5b4a62530d47 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7" status: 404 len: 111 microversion: 2.1 time: 0.028813 Jun 24 15:35:25.157763 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 558/1130] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:25 2022] GET /compute/v2.1/servers/c5126022-24c8-422f-8b3c-4ece0ccd41f7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:35:26.416567 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:26.417084 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:26.423881 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:26.424332 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:26.425094 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:26.425641 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:26.439803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: DELETE /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d HTTP/1.1 Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:35:26.441402 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.443117 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': '7d205fe2-41b4-42a3-aca8-423d2d6ffd2d'} Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:26.444099 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.446724 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.449249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:26.449249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-73e4eb74-291d-4a88-9731-02c3e690f9f2 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 404 len: 111 microversion: 2.1 time: 0.030665 Jun 24 15:35:26.449249 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 573/1131] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:35:26 2022] DELETE /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:35:26.452008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:35:26.452644 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] [instance: 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:35:26.459402 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:26.460486 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:26.461379 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:35:26.461826 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:35:26.474941 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.wsgi [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] HTTP exception thrown: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Request method failure captured: Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: request: GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d HTTP/1.1 Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept: application/json Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Accept-Encoding: identity Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Connection: close Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Length: 0 Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Content-Type: application/json Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Host: 10.222.0.67 Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Openstack-System-Scope: None Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: User-Agent: python-urllib3/1.26.9 Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Auth-Token: gAAAAABitdizz1enfRdwI4RudcZtzQi_H-yTAOBrB0SPnkmT3JyQYQqeZcZqaxhFUpdyiH8-1a_ytcZdSaBRNtiHDG_QGwIL56enOH9UWuFWUH2ml8Uo-O7ovn03QtpIlg_WC_1vyOP4wt1XcNVVyXMOoDM7mXhg7cKSr80tkYyXl43WUBvlG54 Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Id: None Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Domain-Name: None Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Identity-Status: Confirmed Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Is-Admin-Project: True Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Id: default Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Domain-Name: Default Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Role: member,reader Jun 24 15:35:26.477045 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Roles: member,reader Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9c0e7447465d430d9352d9e9b7ea012c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9c0e7447465d430d9352d9e9b7ea012c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Id: 9c0e7447465d430d9352d9e9b7ea012c Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013845358 Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Id: default Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Domain-Name: Default Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Id: 920e7c03e9b94550880b452d84f07128 Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: X-User-Name: tempest-AttachVolumeNegativeTest-1013845358-project Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: method: > Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: exception: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.478670 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: action_args: {'id': '7d205fe2-41b4-42a3-aca8-423d2d6ffd2d'} Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:35:26.479579 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. Jun 24 15:35:26.480819 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: ERROR nova.api.openstack.wsgi Jun 24 15:35:26.482023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] Returning 404 to user: Instance 7d205fe2-41b4-42a3-aca8-423d2d6ffd2d could not be found. {{(pid=118273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:35:26.482023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-8894e18f-9606-4dd4-9553-b51843ae4673 tempest-AttachVolumeNegativeTest-1013845358 tempest-AttachVolumeNegativeTest-1013845358-project] 10.222.0.67 "GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d" status: 404 len: 111 microversion: 2.1 time: 0.030279 Jun 24 15:35:26.482023 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 559/1132] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:35:26 2022] GET /compute/v2.1/servers/7d205fe2-41b4-42a3-aca8-423d2d6ffd2d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:36:33.143191 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_api:SELECT=21 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:33.144417 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:33.148410 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1593761538", "imageRef": "48e9658b-6edc-471c-88b8-dd560ae1193e", "flavorRef": "452"}} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:36:33.198286 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.network.neutron [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] validate_networks() for None {{(pid=118274) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 15:36:33.462412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Flavor limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 15:36:33.462832 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Image limits 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 15:36:33.463341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Flavor pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 15:36:33.463752 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Image pref 0:0:0 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 15:36:33.464187 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.virt.hardware [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 15:36:33.473861 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:33.474310 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:33.475112 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:33.475578 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:33.491862 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Getting quotas for project 2c75120127524a4aa9c97a3032c1dd2c. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 15:36:33.496495 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.quota [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Getting quotas for user 212357bccadb4604a7d2855c9be77f75 and project 2c75120127524a4aa9c97a3032c1dd2c. Resources: {'ram', 'instances', 'cores'} {{(pid=118274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 15:36:33.507148 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Going to run 1 instances... {{(pid=118274) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 15:36:33.510054 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48e9658b-6edc-471c-88b8-dd560ae1193e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 15:36:33.621745 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-745a616c-b769-4b79-bbc8-8f1abb88ca19 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480227 Jun 24 15:36:33.622385 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 574/1133] 10.222.0.67 () {60 vars in 1146 bytes} [Fri Jun 24 15:36:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 15:36:33.630161 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:33.630963 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:33.635567 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-6f0046e7-0c47-4657-99ec-d401c081309b tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:33.636181 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-6f0046e7-0c47-4657-99ec-d401c081309b tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:33.691552 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-6f0046e7-0c47-4657-99ec-d401c081309b tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:33.699172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-6f0046e7-0c47-4657-99ec-d401c081309b tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1215 microversion: 2.1 time: 0.070823 Jun 24 15:36:33.699749 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 560/1134] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:33 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:34.717796 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:34.718406 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:34.724704 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:34.727444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:34.727444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:34.727444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:34.790680 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:34.798273 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-378060c8-d487-4270-943b-70cdf39e036f tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1219 microversion: 2.1 time: 0.085294 Jun 24 15:36:34.798852 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 575/1135] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:34 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:35.819355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:35.819355 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:35.825270 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:35.825713 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:35.826475 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:35.826901 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:36.153739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:36.161144 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-f38424f2-e35c-4779-b082-03c4b4ac70eb tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1273 microversion: 2.1 time: 0.349102 Jun 24 15:36:36.162830 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 561/1136] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:35 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 15:36:37.178667 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:37.179213 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:37.185803 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:37.186355 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:37.187133 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:37.187662 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:37.410570 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:37.419767 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-5d85e74f-1809-4107-9f72-78dedfae9103 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.245740 Jun 24 15:36:37.420394 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 576/1137] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:37 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:37.797712 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-113da594-f445-45d2-abd9-90a3abf2c759 req-e25e10ae-c27a-45c5-9da7-8a695a16f0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb", "tag": "73fdb231-ea43-435f-9a76-1040fac04d04"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:36:37.807115 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-113da594-f445-45d2-abd9-90a3abf2c759 req-e25e10ae-c27a-45c5-9da7-8a695a16f0e5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:37.807598 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-113da594-f445-45d2-abd9-90a3abf2c759 req-e25e10ae-c27a-45c5-9da7-8a695a16f0e5 service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:37.819272 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-113da594-f445-45d2-abd9-90a3abf2c759 req-e25e10ae-c27a-45c5-9da7-8a695a16f0e5 service nova] Creating event network-changed:73fdb231-ea43-435f-9a76-1040fac04d04 for instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb on hv-cinder-83538 Jun 24 15:36:37.825390 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-113da594-f445-45d2-abd9-90a3abf2c759 req-e25e10ae-c27a-45c5-9da7-8a695a16f0e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173817 Jun 24 15:36:37.826279 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 562/1138] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:36:38.436206 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:38.436812 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:38.443228 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:38.443683 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:38.444444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:38.444882 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:38.575207 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:38.582609 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-7c72d991-d3b3-47c0-adf9-c16e5d0d4dc2 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.150281 Jun 24 15:36:38.583172 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 577/1139] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:38 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:39.600692 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:39.601392 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:39.607973 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:39.608429 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:39.609197 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:39.609638 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:39.742241 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:39.750549 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-35aadf18-a415-4aaa-9c17-34270ff07475 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.154505 Jun 24 15:36:39.751118 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 563/1140] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:39 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:40.767261 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:40.767866 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:40.775134 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:40.775595 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:40.776348 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:40.776783 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:40.903934 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:40.911484 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-6106658a-ed4e-445e-a1ae-1311ce9bb51c tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.147962 Jun 24 15:36:40.911993 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 578/1141] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:40 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:41.928589 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:41.929198 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:41.935952 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:41.936245 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:41.937014 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:41.937449 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:42.076799 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:42.080090 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9eec6283-3b8d-4720-b2ae-56d389899281 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.155492 Jun 24 15:36:42.080739 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 564/1142] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:41 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:43.099707 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:43.100485 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:43.108130 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:43.108579 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:43.109345 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:43.109777 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:43.236360 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:43.244115 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-aa75639b-6135-4049-aa27-a1a38d077533 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.149903 Jun 24 15:36:43.244685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 579/1143] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:43 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:44.051308 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG dbcounter [-] [118273] Writing DB stats nova_cell0:SELECT=2 {{(pid=118273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:44.111340 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [req-3621c312-2796-48da-b9e0-76c1008cb522 req-d93fd8a6-5dfd-481e-8b78-ca788ab73bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb", "name": "network-vif-plugged", "status": "completed", "tag": "73fdb231-ea43-435f-9a76-1040fac04d04"}]} {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:36:44.120079 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-3621c312-2796-48da-b9e0-76c1008cb522 req-d93fd8a6-5dfd-481e-8b78-ca788ab73bde service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:44.120578 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [req-3621c312-2796-48da-b9e0-76c1008cb522 req-d93fd8a6-5dfd-481e-8b78-ca788ab73bde service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:44.131378 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.compute.server_external_events [req-3621c312-2796-48da-b9e0-76c1008cb522 req-d93fd8a6-5dfd-481e-8b78-ca788ab73bde service nova] Creating event network-vif-plugged:73fdb231-ea43-435f-9a76-1040fac04d04 for instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb on hv-cinder-83538 Jun 24 15:36:44.136959 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [req-3621c312-2796-48da-b9e0-76c1008cb522 req-d93fd8a6-5dfd-481e-8b78-ca788ab73bde service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087195 Jun 24 15:36:44.137873 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 565/1144] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:36:44.261645 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:44.262257 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:44.264162 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=2 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:44.264821 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG dbcounter [-] [118274] Writing DB stats nova_cell0:SELECT=6 {{(pid=118274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:44.270529 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:44.271002 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:44.271855 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:44.272246 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:44.405894 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:44.413522 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-c7af2fc0-e4dc-4b9a-8fb3-23c0daa06daa tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.156256 Jun 24 15:36:44.414092 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 580/1145] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:44 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:45.431928 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:45.432636 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:45.439541 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:45.439995 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:45.440800 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:45.441253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:45.574008 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:45.581621 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-a864e918-cb70-401d-a29d-7f3ff091f8ca tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1315 microversion: 2.1 time: 0.155547 Jun 24 15:36:45.582172 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 566/1146] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:45 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:46.598759 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:46.599389 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:46.606076 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:46.606522 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:46.607308 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:46.607778 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:46.737361 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:46.744809 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-1624f08f-cf90-47a9-9394-464d125a4acd tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1464 microversion: 2.1 time: 0.149940 Jun 24 15:36:46.745371 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 581/1147] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:46 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:46.784028 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:46.784557 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:46.791199 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:46.791653 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:46.792428 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:46.792869 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:46.817804 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Going to try to terminate instance {{(pid=118273) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 15:36:47.083042 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-9af9b1a0-5a37-423e-8fd2-1c01ac017923 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 204 len: 0 microversion: 2.1 time: 0.302456 Jun 24 15:36:47.083585 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 567/1148] 10.222.0.67 () {58 vars in 1238 bytes} [Fri Jun 24 15:36:46 2022] DELETE /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 15:36:47.092136 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:47.093606 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:47.099341 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:47.099795 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:47.100561 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:47.101001 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:47.230337 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.policy [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118274) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:47.237685 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-2e91851b-7983-4abe-a9fb-14fb603b4f1a tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1470 microversion: 2.1 time: 0.149615 Jun 24 15:36:47.238258 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 582/1149] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:47 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:48.256409 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:48.257111 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:48.264253 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:48.264702 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:48.265483 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:48.265925 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:48.399250 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:48.406645 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-7de86c00-a129-41bd-b35c-0dd4ab3b20b7 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1470 microversion: 2.1 time: 0.154503 Jun 24 15:36:48.407215 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 568/1150] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:48 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:48.965471 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [req-dc471772-da52-467d-b8b8-4c2ad479934a req-a90497c7-7615-45b5-b9e5-fbb9cf46a58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb", "name": "network-vif-deleted", "tag": "73fdb231-ea43-435f-9a76-1040fac04d04"}]} {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 15:36:48.974523 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-dc471772-da52-467d-b8b8-4c2ad479934a req-a90497c7-7615-45b5-b9e5-fbb9cf46a58f service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:48.975095 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [req-dc471772-da52-467d-b8b8-4c2ad479934a req-a90497c7-7615-45b5-b9e5-fbb9cf46a58f service nova] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:48.987412 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.compute.server_external_events [req-dc471772-da52-467d-b8b8-4c2ad479934a req-a90497c7-7615-45b5-b9e5-fbb9cf46a58f service nova] Creating event network-vif-deleted:73fdb231-ea43-435f-9a76-1040fac04d04 for instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb on hv-cinder-83538 Jun 24 15:36:48.993432 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [req-dc471772-da52-467d-b8b8-4c2ad479934a req-a90497c7-7615-45b5-b9e5-fbb9cf46a58f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Jun 24 15:36:48.994193 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 583/1151] 10.222.0.67 () {64 vars in 1317 bytes} [Fri Jun 24 15:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 15:36:49.423735 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.api.openstack.wsgi [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:49.424338 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.compute.api [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118273) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:49.430938 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:49.431423 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:49.432181 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:49.432613 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:49.463280 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:49.463724 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG oslo_concurrency.lockutils [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:49.464165 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.objects.instance [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lazy-loading 'fault' on Instance uuid d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb {{(pid=118273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 15:36:49.504758 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: DEBUG nova.policy [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '212357bccadb4604a7d2855c9be77f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75120127524a4aa9c97a3032c1dd2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118273) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 15:36:49.513190 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO nova.api.openstack.requestlog [None req-b3a36828-fea2-41ce-b7a5-5c357aee4d72 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 200 len: 1305 microversion: 2.1 time: 0.093355 Jun 24 15:36:49.513751 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: [pid: 118273|app: 0|req: 569/1152] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:49 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 15:36:50.531277 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Calling method '>' {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 15:36:50.531956 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.compute.api [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] [instance: d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb] Fetching instance by UUID {{(pid=118274) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 15:36:50.538562 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:50.539013 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:50.539812 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 15:36:50.540248 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG oslo_concurrency.lockutils [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Lock "59aec77a-ef76-4d1f-a2c4-a6cb9d5aa780" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 15:36:50.553366 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.wsgi [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] HTTP exception thrown: Instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb could not be found. Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Request method failure captured: Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: request: GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb HTTP/1.1 Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept: application/json Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Accept-Encoding: identity Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Connection: close Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Length: 0 Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Content-Type: application/json Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Host: 10.222.0.67 Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Openstack-System-Scope: None Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: User-Agent: python-urllib3/1.26.9 Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Auth-Token: gAAAAABitdn_IA9Li58k8bDWcQQViRD0_zh-a23nUBnfSjrcYhVqqOy8nvIX81VQRd-uHBm8VL5dfCZv8xYPJL59zByiLDTYs0lIuwn7Es-Kwe2x7OtSNa0ByPgP10WeyCZ8u0REQr5ur17PNucIWie3osWpTi1KFfz9JrfIy82lyXdYSR3Gizc Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Id: None Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Domain-Name: None Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Identity-Status: Confirmed Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Is-Admin-Project: True Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Id: default Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Domain-Name: Default Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Id: 2c75120127524a4aa9c97a3032c1dd2c Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Project-Name: tempest-VolumesNegativeTest-1932850434 Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Role: member,reader Jun 24 15:36:50.555539 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Roles: member,reader Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2c75120127524a4aa9c97a3032c1dd2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2c75120127524a4aa9c97a3032c1dd2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2c75120127524a4aa9c97a3032c1dd2c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2c75120127524a4aa9c97a3032c1dd2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}] Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant: tempest-VolumesNegativeTest-1932850434 Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Id: 2c75120127524a4aa9c97a3032c1dd2c Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-Tenant-Name: tempest-VolumesNegativeTest-1932850434 Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User: tempest-VolumesNegativeTest-1932850434-project Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Id: default Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Domain-Name: Default Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Id: 212357bccadb4604a7d2855c9be77f75 Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: X-User-Name: tempest-VolumesNegativeTest-1932850434-project Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: method: > Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: exception: Instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb could not be found. Jun 24 15:36:50.557262 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: action_args: {'id': 'd5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb'} Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: {{(pid=118274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb could not be found. Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 15:36:50.558444 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb could not be found. Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb could not be found. Jun 24 15:36:50.560287 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: ERROR nova.api.openstack.wsgi Jun 24 15:36:50.562122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: DEBUG nova.api.openstack.wsgi [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] Returning 404 to user: Instance d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb could not be found. {{(pid=118274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 15:36:50.562122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO nova.api.openstack.requestlog [None req-d7716384-c4b4-4528-b918-0dbc76f28517 tempest-VolumesNegativeTest-1932850434 tempest-VolumesNegativeTest-1932850434-project] 10.222.0.67 "GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb" status: 404 len: 111 microversion: 2.1 time: 0.029912 Jun 24 15:36:50.562122 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: [pid: 118274|app: 0|req: 584/1153] 10.222.0.67 () {58 vars in 1235 bytes} [Fri Jun 24 15:36:50 2022] GET /compute/v2.1/servers/d5be11a3-5c7c-4a9b-8ee8-1fecb01a56cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 15:37:33.160124 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:37:33.160740 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:37:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:38:58.334551 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:38:58.335141 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Fri Jun 24 15:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:39:00.108511 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:39:00.108966 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:39:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:39:49.012231 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:39:49.012777 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Fri Jun 24 15:39:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:40:24.866976 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:40:24.867608 dv-cinder-835384-11-iscsi devstack@n-api.service[118273]: Fri Jun 24 15:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:40:53.168429 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:40:53.168980 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:40:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 15:42:01.451464 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 15:42:01.452190 dv-cinder-835384-11-iscsi devstack@n-api.service[118274]: Fri Jun 24 15:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!